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ABSTRACT 



A class of sequential procedures for estimating the mean 
of a normal distribution having known variance from quantal 
response data is discussed. This class Includes as special 
members the up-and-down method and other procedures commonly 
used in biological assay. A method of evaluating alterna- 
tive procedures belonging to a given subset of the class is 
presented. This method is essentially an application of 
Wald's decision theory. A loss plus cost objective function 
is used and the efficiency of a particular procedure is 
determined by its ability to satisfy one of the four cri- 
teria considered. Criteria are discussed for use with both 
the expected value and variance of the total loss, which 
may be determined from matrix, equations that are derived. 

Two applications are given. The first is an application to 
procedures commonly used in biological assay. In the second, 
an application to the elevation procedure of the precision 
registration technique used by U.S. Army and Marine Corps 
field artillery units, it is seen that under certain condi- 
tions, Dixon's modified up-and-down method strictly dominates 
the elevation procedure currently in use. 
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I. 



INTRODUCTION 



The up-and-down method Is an experimental procedure for 
estimating the median of a continuous distribution function 
G from quantal response data. The procedure, which origi- 
nated from testing the sensitivity of explosives to shock, 
is applicable to experimental situations which deal with 
continuous variables which cannot be measured [6]. 

The biological assay problem, for example, is an appli- 
cation which has been studied by Dixon and Mood [6], 
Brownlee, Hodges, and Rosenblatt [2], Dixon [4], Tsutakawa 
[15] and others. The objective in the bio-assay problem is 
to determine the critical dose of a drug above which greater 
than fifty per cent of the test specimens respond. As Dixon 
and Mood visualized the problem, 

"... a critical dose is associated with each insect 
(test specimen), but one cannot measure it. He can 
only try some dose and observe whether or not the 
critical dose for that insect is less than or 
greater than the chosen dose." [6]. 

In performing a bio-assay experiment a prescribed number 
of specimens is usually tested at each of several fixed dose 
levels. If the up-and-down method, originally studied by 
Dixon and Mood, is used, some initial dose level in a set of 
equally spaced dose levels is chosen for testing the first 
specimen. The next specimen is tested at the dose level 
immediately below or above the dose level of the previous 
test depending upon whether there was or was not a response 
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on the previous test, and so forth [ 5 ]. Note the structure 
of this procedure. A trial Is performed using one specimen. 
After the initial trial, the level used in succeeding trials 
of the experiment is determined by the response from the 
preceedlng trial. Tsutakawa [15l studied a generalization 
of the up-and-down method in which the number of specimens 
tested per trial is a constant which is at least one. In 
the first trial of Tsutakawa' s procedure, which he calls a 
"random walk design", a group of k i 1 observations (that 
is, k ^ 1 specimens are tested) is made at some level in 
a set of equally spaced levels. Here, each observation in 
a trial is a response or nonresponse depending upon whether 
the value of the random variable having distribution G is 
less than or greater than some known value; that is, if the 
specimen responds, then it is Inferred that the critical 
value (the median of G) is less than the value used to test 
the specimen. Succeeding trials of the experiment are made 
at levels Y 2 ,..., with k observations per trial, deter- 

mined by : 



( Y, + n, 


if 


0 


1 Jt 1 






if 


k° 


<J^<k-k°, t >1 


(1) 




if 


k ■ 


- k° < < k 





where m is the interval between successive levels, is 
the number of responses on the t-th trial, and k° is a 
predetermined Integer such that 0 < k° < k - k°. This 
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procedure generates the sequence } and is designated 

W(k, k°) by Tsutakawa. Note the differences between the 
up-and-down method and W(k, k°). In the latter, a trial is 
performed using k specimens and the level used in succeeding 
trials of the experiment is determined by the number of 
responses from the preceeding trial. Notice also that the 
design W(l, 0) is identically the up-and-down method. 

The procedures of concern in this study are sequential 
sampling procedures for estimating the mean of G. The 
purpose of this study is twofold: to extend Tsutakawa' s 

procedures, and to formulate a methodology for evaluating 
alternative procedures. The procedures to be studied differ 
from Tsutakawa' s procedures, W(k, k°) in that: 

1) It is assumed that G is a normal distribution 
having known variance. 

2) It is assumed that 7^ , a set of equally spaced 
levels, is finite. 

3) The number N* of trials taken in the experiment 
is a random variable. 

4) The number k of observations taken per trial is 
not necessarily constant throughout the experi- 
ment . 

5) Successive trials of the experiment are not 
necessarily performed at successive levels 
in Z7? .1 



In discussing his results, Tsutakawa [15] suggests 
that the experimental situation may prompt a widening of 
his class of procedures wherein k and m in equation 1 
are permitted to vary. The properties 4) and 5) above 
permit such variations. 
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Thus, Itlf} is a finite set of equally spaced levels, then 
(Z i the class of procedures to be studied. Is defined as a 
class of procedures for estimating the mean of a normal 
distribution, having known variance, from quantal response 
data which have the properties 3), and 5) given above. 
When both 4) and 5) are restricted (that Is, k Is constant 
and successive trials are performed at successive levels), 
then Tsutakawa's procedures, W(k, k'^), belong to , a 
case which Is discussed separately as a special case of 
the general procedure In CZ . 

It is assumed that the experimenter has selected a 
nominal sample size or a nominal number of trials for the 
experiment and can select a set of equally spaced levels 
(this set Is a subset of 7)1) for the experiment which 
Include the mean of G. Here, the term "nominal" is used in 
the same sense as used by Dixon [4]; that Is, as first 
suggested by Brownlee, £t ^ [2], some of the observations, 
usually a string of responses or nonresponses, are discarded 
as being indicative of a poorly selected Initial level. To 
perform an experiment using the general procedure, the 
experimenter selects a stopping rule which depends upon 
the sequence of responses. He chooses the Interval between 
trials; that Is, whether successive trials are to be per- 
formed at successive levels or at Irregular levels. For 
example, he may desire that the spacing between trials 
decrease when the responses obtained Indicate he Is testing 
near the mean. He then decides upon the number of 
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observations per trial to be taken and the observation/ 
response combinations which determine whether the next 
trial will be performed at a higher level, a lower level, 
or the same level. For Instance, in the up-and-down method 
the observation/response combinations are 1/0 and 1/1. In 
the first case, the next trial would be performed at a 
higher level; while in the second case, it would be per- 
formed at a lower level. These choices can be made in 
advance because the experimenter knows the nominal sample 
size. After experimentation, the estimate of the mean is 
determined using one of several estimators. 

The general procedure is evaluated by representing the 

estimate of the mean, derived by use of the procedure, as 

the level nearest the estimate. This is an approximate 

representation which can be made as accurate as one pleases 

by increasing the number of levels while decreasing the 

spacing between levels. Thus, the total loss, in deciding 

the estimate is at a particular level, can be taken as the 

loss associated with deciding that it is at some level plus 

the cost of sampling. Hence, the problem of determining 

an optimal procedure W* in f , a set of procedures in / under 

consideration, is the decision problem formulated by Wald 

[17]. Matrix equation, derived for the expected value and 

variance of the total loss, are used with one of four crl- 

2 

terla discussed to determine the optimal procedure. The 

2 

This approach was suggested by the approach used in 
a report by Elfvlng [l4]. 
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criteria considered consist of the usual Bayes and mlnlmax 
criteria used In conjunction with the expression for the 
expected loss. In addition, two analogously defined 
criteria are used In conjunction with the expression for 
the variance of the loss. In the special case. It Is shown 
that choosing the number k**, of observations per trial 
which minimizes the expected value of the total loss Is 
equivalent to finding a procedure which satisfies the Bayes 
criterion. 

The present study was motivated by a gunnery problem 
encountered by U.S. Army and Marine Corps field artillery 
units. The problem Is that of determining a basis for 
corrections to an element of firing data called elevation. 
Here, elevation Is an angle to which a gun tube must be 
raised In order that the center of Impact of a group of 
projectiles fired from the tube will be at a given distance 
called the range, from the gun. The procedure, currently 
used to determine the adjusted elevation. Is known as the 
elevation procedure of the field artillery registration 
technique. While the origin of the current procedure Is 
obscure. It Is known to have evolved from earlier procedure 
In use since World War II. After an adjustment phase In 
which the center of Impact Is moved near a known point 
referred to as the registration point, the procedure essen- 
tially consists of; observing whether a projectile bursts 
beyond or short of the registration point; then, changing 
the elevation setting after a prescribed sequence of 



responses have been observed. This pattern of experimen- 
tation is continued until a nominal sample size of six 
bursts have been observed. Then, the adjusted elevation 
is computed. 

Notice the similarity in the problem of determining 
the adjusted elevation and the bio-assay problem. Para- 
phrasing Dixon and Mood, an adjusted elevation is associated 
with each registration point, but one cannot measure it. 

He can only try some elevation setting and observe whether 
the projectile bursts beyond or short of the registration 
point, that is, observe whether the adjusted elevation is 
less than or greater than the chosen elevation setting. 

It was discovered that Tsutakawa's procedures, which 
Include an earlier version of the elevation procedure, do 
not Include the procedure currently in use because of pro- 
perties 4) and 5) listed above for procedures in the class 
C . Thus in order to evaluate the current procedure and 
some alternative procedures, it was necessary to consider 
a wider class of procedures. 

The reader Interested primarily in the application to 
the elevation procedure of the precision registration tech- 
nique may omit Sections IIB and IIIC. The reader Interested 
in the more general aspects of the problem may omit Section 
IIIC-2 and Chapter IV. 
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II. THE GENERAL PROCEDURE 



An extension of Tsutakawa's procedures will now be made 
precise. Let 7^' = {..., be a set of 

equally spaced levels with Interval m where the are mid- 
points of the set of Intervals 




i 



-.- 3 m -m 




' -m m 


fm 3 m ' 1 


2 » 2 




2 ’2| 





( 2 ) 



For later convenience, let m^ be the mean of G. Let 779^^ a 
finite subset of 7r}' containing m^ , be known to the experi- 
menter; that Is, assume that the experimenter has sufficient 
knowledge of the random variable having distribution G to 
select a subset of the levels of for the experiment 

which contains m^ . This can be done without serious loss 
of generality because the variance of G Is known and the 
experimenter need not know the specific level In 779 ^’^ which 
Is mQ . It Is further assumed that the experiment begins at 
some randomly selected level In 7 ;?^^ but. In general, some 
of the trials of the experiment may be performed at levels 
not In 77l"’ Thus, In the experiment described below, a 
random number N* of trials Is performed at the levels In 






In the general procedure, the first trial of the experi- 
ment Is performed at level In 779 '' where a set of k^ 
observations are taken. On the n* - 1 succeeding trials of 
the experiment, k 2 , . . . , k^** observations are taken at levels 
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Y * determined by: 

I Yj + C^-m If 0 <Jj<k^° 

^t+1" 

Yf - Cj.m If k^-k^°lJjlk^ 

o 

where {C^: - 1 £ ^t + 1 £ ^ sequence of pre- 

determined Integers which determine the spacing between 
levels at which trials are performed; ^ sequence 

of predetermined Integers which determines the number of 
observations per trial; ^ sequence of predeter- 
mined Integers such that 0 £ - k^°; and is the 

number of responses on the t-th trial. Thus, the experi- 
menter selects a level in 7/l" for the first trial of the 
experiment. Succeeding trials are performed at levels 
determined by use of the sequences and 

which are known to the experimenter and which the 
experimenter observes. Each observation is a response or 
nonresponse depending upon whether the value of the random 
variable having the normal distribution G is less than or 
greater than some known value. 

The number N* of trials of the experiment is determined 
by use of a stopping rule 6. Here, the set of stopping 
rules under consideration is such that N* is finite and a 
particular rule 6 depends upon the sequence in a 

manner similar to that suggested by Brownlee, ^ al_ [2] and 

The restriction on is discussed below. 
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used by Dixon [i|] in his study of the up-and-down method 
for small sample sizes. For example, if = 1 for all t, 
then a typical rule 6 might be to perform six trials of 
the experiment after the first reversal (that is, first 
response after a string of nonresponses, or vice versa) 
in the sequence Thus, for a given performance of 

the experiment, the number N of observations is determined 
by the rule 6 and the sequence {k^} from 

N* 

N = Z k, . (1|) 

t = l ^ 

The general procedure described above generates the 

sequence which forms a random walk on the levels in 

7 )^' , and determines N. The general procedure is a modified 

Tsutakawa random walk procedure and will be designated 

W(6, k^ , k^°, ) or simply W when no confusion results 

from the abbreviation. Notice the differences between 

Tsutakawa's W(k, k°) and W(6, k^ , k^°, C^). Instead of 

a fixed number of observations, the latter uses a stopping 

rule to determine the number of observations. Sequences 

rather than constants are used in W(6, k , k °, C, ) to 

U t/ ^ 

determine the level of each trial, the spacing between 
levels used for successive trials and the number of obser- 
vations per trial. Notice also that the procedure 
W(6, k^, k^°, C^) = W(6, k, k° , 1) is identical to Tsuta- 
kawa's procedure W(k, k°) except for the rule 6, which has 
been Incorporated into the former. Procedures of the type 
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W(6, k, k°j 1) will be referred to as a special case of the 
general procedure in J. and will be discussed separately 
below . 

In the above, the general procedure has been described 
with the performance of an experiment In mind. That Is, 
the information known to the experimenter has been given 
and the procedure he should follow has been outlined. In 
that which follows, the discussion will begin to focus on 
the second purpose of the study — to formulate a methodology 
for evaluating alternative procedures In * . Here, it is 

convenient to view the general procedure from the stand- 
point of an experimenter Interested In determining which 

procedure among a set of alternative procedures in the class 
ij 

Is best. When viewed In this light, the general procedure 
can be characterized by two stochastic matrices which 
facilitate the evaluation. 

A. TWO MATRICES WHICH CHARACTERIZE THE GENERAL PROCEDURE 
If a single observation Is made of the random variable 
having distribution G, then and 3^, the probabilities 
of response and nonresponse at the l^'^ level in A i ^ , are 

= G(m^) = l-3j_; 1=0, ±1,... . (5) 

Note that If 1 = 0, then = GCm^) = 0.5 = 3g. Also, it Is 
clear from the symmentry of G that there exists levels In 



The sense in which a procedure Is best or optimal will 
be clarified below. The term efficiency Is also used to 
mean the degree of optimality of a procedure. 
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77 ? j equidistant from mg, say m_^ and m. 



u 



such that 



a = G(m ) = 0 

-u -u 



( 6 ) 




so that levels m_^ and m^ may be taken as reflecting 
barriers. Let ??? be such a subset of 77?^; that is, let 
TV = {m_^, . . . , mg,..., m^} where the index u is chosen such 
that the set of levels known to the experimenter, is 

contained in yfl. Thus, it follows that the experiment 
begins at some randomly selected level in • Note however 
that if 1 for some t, then the (t+ 1 )^^ trial of the 

experiment may be performed at some level not in 7)1. Sup- 
pose, for example that the t-th trial is performed at 
level that = v, v 7 ^ 1. Then it is possible 

that the (t+ 1 )^^ trial will be performed at level m . ,, 

^ u+v- 1 ’ 

a level which is outside the reflecting barrier at level 
m^. To get around this difficulty, all the levels outside 
m_^ and m^ may also be taken as reflecting barriers and 



sequence {C^}. Under these assumptions, it follows that 
the sequence cannot contain two successive levels not 



When the experiment ends, the experimenter may compute 




in 7)1 . 



an estimate of the mean of G, say m^ , using one of several 



5 

Mote that this difficulty does not exist in the special 
case where = 1 for all t. 
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This corn- 



estimators which will be generically denoted Y. 
putation may be performed using all or part of the data in 
the sequence J^} together with N, N* , and m. Now 

m^ is in one of the intervals of ^ , given by equation 2, 
the midpoint of which is given by one of the levels in ^ ; 
that is, m^ may be represented by one of the levels In T7l ' . 
And since the sequence ^Y^} cannot contain two successive 
levels not in 7>l , it is reasonable to assume in the general 

/N 

procedure that m^ may be represented by one of levels in 
Tp . This assumption is not necessary in the special case 
because there is in 77) for all t. Thus, when it is said 
that the experiment ends at a level in V) , it is meant that 
mg is in 7)1. 

The sequence {Y^} generated by W can be classified as 
an Integer valued discrete time stochastic process having 
state space 77}' = -1, 0, 1,..,} and parameter space 

T '= {Ij where In 77) ' , mg = 0 and the Interval m = 1. 

Expressions for the one-step transition probabilities that, 
on the (t+1)^^ trial of the experiment, the process goes 
up a level, ^ remains at the same level, or goes down a 
level may be found using (3) and the fact that is dis- 
tributed blnomlally with parameters k, and a., which is 

U 1 

given by (5) . 



To perserve 
the term "level" 



the terminology of the up-and-down method 
will be used in lieu of the term "state." 



21 



Let 



( 



1,J 



= < 



r . 

1 



J = 1 + 

J = i 

j = 1 - C, 



(1 = 0 , ± 1 ,...) 



(7) 



otherwise 



denote the probability that the process goes to the J-th 
level on the (t+1) trial given it was at the 1-th level 
on the t-th trial. Then it follows from (3) that 

kt° 1^ 

Pi = Pr(0<.J^<k^°) - 



1 ''t-J 

aJ 6, 



r. = Pr(k, °<J, <k, -k, °) = Z 
1 t t t t . , o., 

j=k^ +1 



k -k -1 

^t ^t -^fk, \ , k,-o 



; “i ^ 



( 8 ) 



q, = Pr(k^-k^°<J^<k^) = Z 



J=kt-kt° \ ' / 



a-! a/t-J 

1 1 



where Pj^riOj ^li^, q^^^O and p^+r^+q^ = 1; 1 = 0,11,... 

Now consider the triplet (7^, W, Y). Let raT^, determined 
by use of Y, be represented by one of the levels in TY) , 

Recall that when the experiment is performed, sampling 
begins at some level In lY) . Now the actual level In 7V at 
which sampling begins is a random variable, say Q, which 
depends upon prior knowledge of the experimental situation. 
Likewise the level in TY) which represents nT^ Is also a random 
variable, say M, which depends on W, G, and Y. Given the 
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triplet {1)1 ) W, Y), the joint probability that M = j and 
N = n, given Q = iel}], denoted by 



N|Q ’ n|i)(i, j-0, .••} ±u;n n^j...,ny), ( 9 ) 

can be found using equations 8. Here n^ and n^, the lower 
and upper bounds, respectively, on the number N of observa- 
tions are finite for a given stopping rule 6 because N* is 
finite. Equation 9 is an expression for the probability 
that the experiment ends at level jeTO after n observations, 
given the experiment begins at level iel)) . Let £ = 2u + 1 
be the total number of levels in 7)1 , Denote by 

^ij = %|Q ^ ^M,N|Q 

the conditional probability that the experiment ends at 
level j given it begins at level 1. Then A = is a 

I X a stochastic matrix which will be referred to as the 
Procedure Transition Matrix . Similarly, denote by 



^Ij ®N|Q ^ ^M,N I Q I 

the conditional probability that the experiment ends after 
j observations given it begins at level i. Then B = (b..) 
is a £ X (ny-n^ + 1) stochastic matrix which will be referred 
to as the Procedure Iteration Matrix . It will be shown 
below that the matrices A and B characterize procedures 
in . 
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B. A SPECIAL CASE 



Consider the special cases W(6, W(6, k, k°, 1) 

in (S' . In dealing with these cases, it will be convenient 
to work with the random variable N*, the number of trials, 
rather than N the number of observations. Since k^ = k for 
all t, N, which is easily obtained from (i|), becomes 

N = k N*. (12) 

This change Is made to permit easy comparison among pro- 
cedures having a different number k of observations per 
trial. Since C^ = 1 for all t, all the levels In lY) are 
accessible from any level In in a finite number of trials 
(that is, all the levels communicate with each other). 
Moreover, the probability that a particular level in W is 
selected for the (t+1)^^ trial depends only on the level 
used and the response obtained on the t-th trial. Hence, 
the stochastic process t^l} generated by W(6, k, k°, 1) 

has 77] as its state space, forms a random walk on}}] between 
reflecting barriers at levels -u and u and is thus a finite, 
irreducible Markov chain. 

In particular, the elements of the I x I one-step 
transition probability matrix P = (Pj^j) are given by (7) 
where from (8) 



7 

The terminology used in classifying the chain corres- 
ponds to that used by Cox and Miller [3] and Karlin [11]. 



2^ 



i=-u 



p. = Z I a.-’ 6.*^ ^ 

1 J=0 'Ji " ^ 



i = -u+l j . . . j u-1 



i=u 



k-k°-l / , 1 . , . 

r = E h a.J 

1 J=kO+llJ) ^ ^ 



i=-u+l j . . . ,u-l 



( 13 ) 



i=±u 



i=-u 



k 

Z 



( k 



j=k-k° ^ 



a.J 3.^"J 
1 1 



i=-u+l , . . . ,u-l 



i=u 



and use has been made of equations 6 for i = ±u. Thus, P 
has positive elements only on Its principal diagonal and 
the diagonals Just above and below the principal diagonal; 
that is j P is of the form 
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0 



1 



0 



f ‘^-u+1 ^-u+1 P-u+1 



P = 



Q 1 n 

^U-1 U-1 



P 



U-1 



where the (i-2) x (Z-2) sub-matrix of P which excludes 
the first and last rows and columns of P is a matrix of 
Jacobi [8]. Furthermore, it follows from (5) and the 
symmetry of G that = 3^; and thus p_^ = r_^_ = r^ 

and ~ ^i “ 0 , ±1 , . . . ,±u) . With these results the 

matrix P can be rewritten 
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0 



1 



0 



u-1 



u-1 ^u-1 



P = 



Pq ^0 Pq 



( 1 ^) 



Q n r T p , 

^u-1 u-1 ^u-1 

0 10 



Note that P has the property that If the elements above the 
secondary diagonal are transposed, the resulting matrix Is 
symmetric with respect to the secondary diagonal. This 
property will be referred to as reflective symmetry about 
the center element r^ . Note that If k =1, then k°= 0 by 
definition and It follows from (8) that 

r. = P^(0<J^<1) = 0 

for 1 = 0,±1, ...±(u-l). Thus when k=l the principal 
diagonal of P contains all zeros. 

The stochastic process t^l} can now be further 

classified for k>l. To determine the periodicity of the 
chain. It Is sufficient to consider the elements r^^ In P 
and the level 0 [11]. When k = 1 , r^ = 0 for all 1, and 
the chain has period two since a return to the starting 
level Is possible only In an even number of trials. When 



2 ? 



k>l, i’q> 0 and the chain is aperiodic since the process can 
reach level 0 and remain there indefinitely regardless of 
its initial level in W . The chain is necessarily positive- 
recurrent because its state space W is finite; that is, the 
probability that the process returns to level 1 after a 
finite number of trials is one. Hence the stochastic process 
{Y^; t^l} formed by W(6j k, k°, 1) is completely classified. 
For k>l, the process is a finite, irreducible, aperiodic 

O 

Markov chain and hence stationary probabilities can be 
found for the chain. 

It was mentioned earlier that one may wish to compare 
procedures of the special case having a different number k, 
of observations per trial. With this in mind as an eventual 
objective, the asymptotic property of the P matrix as k 
Increases is next considered. Note that (l4) can be written 






1 0 
Pu-1 l-Pu-l-'^u-l 



q 



u-l 




P B 



Pq ^-2Po Pq 



(15) 



^u-1 1-Pu-l-Pu-lPu-l 
0 10 



If a chain is both positive-recurrent and aperiodic 
it is said to be ergodic [31. Kemeny and Snell [12] call 
a chain of this type a regular Markov chain. 
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and from ( 13 ), for k°<“, it is seen that 



lim 

Pi 



lim 

k^co 



0 . 



Hence 




lim P 

k-»-oo 



01 0 = P* 



( 16 ) 




where I is a (^-4) x (Ji-4) identity matrix. Intuitatively , 
this limit property implies that as the number k, of 
observations increase without bound, the probability that 
the process t^l) remains at its starting level is one, 

for 1=0, ±1,..., ±(u-l). This can also be seen from (3) 
by noting that 



In the two sections which follow, the properties of the 
A and B matrices Introduced earlier will be considered. 
First, changes as a consequence of (12) will be noted. Then 
the asymptotic properties of the A and B matrices as k 
increases without bound will be considered for a specific 
example . 

1. The A and B Matrices 



the special cases are found in a manner analagous to that 




The Procedure Transition and Iteration Matrices in 
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used above. The resulting expressions can be obtained by 
replacing N by N* in (9)-(ll). The i-th row of A is, as in 
the general case, the conditional probability that the 
experiment ends at level J given it begins at level 1; while 
in this case, the i-th row of B is the conditional prob- 
ability that the experiment ends after j trials given it 
begins at level i. 

2. Properties of the A and B Matrices Given the 

Triplet (7», W, y) ~ 

As a result of the fact that the stochastic process 
{Y^; t>l} generated by W(6, k, k°, 1) is a finite, irredu- 
cible Markov chain and the parameters k and k° are constant 
for any particular W, the A and B matrices can be further 
studied to determine their asymptotic properties as the 
number k of observations per trial for a given triplet 
ilD. W, Y). 

Consider the set of procedures, in defined by 
W(6, k, k , 1) = W(6^, k, 0, 1) where the rule 6^ is to 
stop the experiment after both responses and nonresponses 
have been observed on two successive trials. For simplicity, 
let Tn = {-2, -1, 0, 1, 2}. Then A = 5; m = 1; n*. = 2; 
and, since it is possible to start the experiment at level 
-2 and not obtain a response until level 2 is reached, 

n*u = 5. Prom ( 15 ) the one-step transition probability 
matrix P is 
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-1 



0 



1 



2 



P = 



-2 

-2 To 

-liPl 
0 0 
1 0 
2 0 



1-Pl-Ql 

PO 

0 

0 



l-2p. 



0 

0 

Po 

1-Pl-Ql 



0 

0 

0 ^ 



(17) 



where from (3), (8) and (13) for k = 0, 






k 



Pi = Pr(Yi^i = ±2 |Yi = ±1) = e. 



■Si “ ' ol'’t = = “l 



k 



+ l = *1|Y, = ±2) = 1 



To determine the probability fj^j {>j«|q that the experi- 
ment ends at level M after N* trials given It started at 
level Q, It Is convenient to first consider which combi- 

/N 

nations of levels and responses are required by Y to place 
itIq at a particular level In //) . Here^ the estimator ^ 



n 



* 



n 






^1 m 

Y = i E Y, - E J, + m, 

t=n«-l ^ ^ t=n*-l ^ 



(18) 



from the elevation procedure of the field artillery pre- 
cision registration technique (discussed further In IV) will 
be used. Note that the estimator (18) requires data from 
only the last two trials, the same number of trials 
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specified by the stopping rule; that is, the mean is com- 
puted from the data obtained from trials at two successive 
levels in W which result in both responses and nonresponses. 
Note also that in case there are k total responses, then 
(l8) reduces to the mean level tested on the last two 
trials. Next, recall that the set of levels^ represents 
the midpoints of a finite set of disjoint intervals of 
equal length m, where the level 0 (the mean of G) repre- 
sents the midpoint of an open Interval and the remaining 
intervals are half-open. Here, since m = 1, W = {-2,..., 2} 
represents the set of Intervals, 




11 ^ 

If m^ is in the interval (--^ , ^) , then m^ is represented by 

level 0 and the random variable M is zero. 

It will now be shown that sufficient conditions for 
determining the value of M can be given on the total number 

Jip responses obtained on the last two trials. If the 

experiment starts at level 0 (that is, Q = = 0) and 

I^Jj— ^ then it follows from (13) that ¥ 2=0 since 

k° = 0. Also the experiment will end in this case after 
two trials regardless of the outcome of the second trial. 
Prom ( 18 ) one can determine upper and lower bounds on the 
total number of responses observed on the last two trials 
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3 



n 



* 



t=n*-l 



which are sufficient to determine the level of m and thus 

o 



M, 



That is; for M = 0 it must be true that 



- 1^1 
— < mQ < 2 • 



If = 0, and ¥ 2=0 then it follows from (I 8 ) and the 
fact that N* = 2 that 



-1 T 1 

^<0 ^+ 1<4 

2 k 2 



which implies that 



< < 2 k - 



k 



( 20 ) 



where 



denotes the greatest Integer in Similarly 



for M = -1 and M = 1, given = 0 and Y 2 = 0, it follows 



that 2 k - I |- 



< < 2 k - 1 and 1 1 J,p 1 | 



j respectively. 



In a like manner sufficient conditions on Jrp for determining 
M can be found for other outcomes of the experiment and 
conveniently displayed at the terminal branches a logic tree 
such as that shown at Figure 1 for Q = 0. It should be 
noted that the lower bound condition on J,p determines the 
upper bound for M and vice versa. For example, if Y^ = 0 
and = 0, then using (I 8 ) and (20) one obtains for M = 0, 



max m^ = 0 - — 
0 k 



k . , n 1 e 
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Second Third 

Trial Trial I Total Responses 
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Figure 1. Logic Tree for W(6^,k,0,l) on/^l = {-2,..,, 2} Given 

the Experiment Begins at Level 0 (Here Y is given bv 
equation 18) . 



i k 

since ! 5 - 

! ^ 



< ^ + G < J^, for some e > 0 , and 



^ n l/Ol \lT ll£ 

min mQ = 0 - j^( 2 k-- 2 -e) 



k 



Tk! 



since < 2 k - < 2k “ some g > 0. Note that 

the number N*, of trials is readily determined for each of 
the tree branches . 

The joint conditional probability f^^ n*|Q deter- 

mined using diagrams such as Figure 1, the P matrix, and 

conditional probability arguments. Let g. . be the prob- 

1 3 J 

ability that the total number of responses obtained on the 

last two trials satisfies the sufficient conditions for 

M = j given that the last trial was at level 1. In general, 

these probabilities are easily obtained except when two 

successive trials are conducted at the same level. For 

2 '' 5 

Instance, from Figure 1 note that ^ 5 . hIq < ■^, the condition 
for M = 2, is satisfied by the upper most branch of the 
tree; that is. 



® 2,2 ^ ^ ^ 

= = k|j2 = 0) = 1 . 

And when M = 0, it is seen that 



(21) 
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£o,o = 



< < 2k - 



1 £ < k - 1 



= Pr 



+ 1 ^ 1 2k - 



- 1| 1 < < k-1 



k-1 
I Pr 
J = 1 



+l-j<Jp£2k- 



- 1- j|Jl = jj 



Pr(l 1 1 k - 1) 



( 22 ) 



In a similar manner, one obtains: 



g- 



= Pr(l < J 2 1 k|j^ = 0) = 1 - p^. 



> 0,1 



k-1 

E 

= 



E Pr(l - j < J 2 1 



- j|Jn = J) 



Pr(l 1 1 k - 1) 



So,-i 



k-1 

E Pr(2k - 

iz2 



k 

2 



- j < J 2 1 2k - 1 - j| Jp = j) 



Pr(l < < k - 1) 



(23) 



= Pr(0 1 J 2 1 = k) = 1 - pp, 

g_2 _2 = Pi>(J2 ^ 01^2 = = P* 



Note that the g, . , 1?^ 0, can be expressed In terms of the 

1 y 1 

elements of the P matrix given by (17). Also, the denomi- 
nator of the expressions for gg j , j = -1, 0, 1, Is by (13), 
equal to r^. These two relationships were also found to 
hold when Q/0. Note also that gg p and gg _p are the tall 
probabilities of the conditional probability distribution 
of the random variable given the random variable Jp Is 
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1=1,2. Indeed, it 



not 0 or k and that g. . = g_. 

1 3 1 -L 

can be shown from expressions similar to (20)-(23) that 

for l,j = 0, ±1, ±2. Thus, the notation can be eased some- 
what in the discussion that follows. 

From the Markovian nature of the procedure being studied 
it follows that the joint conditional probability, f^^ n*|Q’ 
is now easily written for Q = 0 using equations (21) through 
( 23 ), the elements of the P matrix given by (17) j and Figure 
1. That is; 



^M,N*|Q 


(2, 


II 

o 

on 


®2 


,2‘ 


Pr(Y^= 


=2|Y2^^)-Pr(Y2=l|Y^=0) = p^p^. 


^M,N*|Q 


(1, 


2|0) = 


^1 


,1* 


Pr(Y2 = 


=l|Y^=0)+gQ^^‘Pr(Y2=0|Y^=0) 






= 


Po 


(1- 


Pq) + ’ 


1 — 1 

o 
bO 
O 
c . 


^m,n*|q 


(0, 


II 

o 

C\J 


So 


,0 ■ 


Pr(Y^ = 


‘PV") = Vo.o- 


^m,n*|q 


(-1 


,2|0)= 


So 


,1* 


Pr(Y2= 


-l|Yj^=0)+gjj •Pr(Y2=0|Yj^=0) 






= 


Po 


(1- 


Pp ^ ■'oSo.i’ 


^m,n*|q 


(-2 


II 

o 

on 


®2 


,2* 


Pr(Y^ = 


=-2|Y2=-1) •Pr(Y2=-l|Y^=0)=PpP^ 



Note that 

^M,N*|Q = 2p^ + r^ g^^j = 1, 



I 0 k = 1 

since Z g^ . = 1 and r = < 

j ° 

The probabilities, fj^j jq*|Q (jjn*|l) for 0, can be 
determined in a similar fashion so that from (10) and (11) 
the procedure transition and iteration matrices can be 
written : 
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C\J 



1 — 1 


1 — 1 




1 — 1 




Q. 


Q. 


1 — 1 


bO 




CM 


I — 1 


1 — 1 


a 


1 — 1 


1 — 1 


cr 


cr 


o 




a 


o 


o 


a 


+ 




Q. 


a, 




rH 










a, 








1 — 1 




















o 


rH 




1 — 1 


1 1 


bO 


•% 




Q. 


o. 


O 


( — 1 


1 — 1 


1 


1 




bO 




1 — 1 


1 — 1 


H- 


rH 


+ 


1 — 1 










1 — 1 






rH 


+ 


o' 


1— 1 


rH 


Q. 


rH 


o 


O' 


O' 


1 


O' 


a. 


o 


O 


I — 1 


O 




Q. 


Q. 




Q. 








O 










a 








O 




O 
















( — 1 




1 — 1 






bO 


o 


bO 




1 — 1 


rH 




rH 


1 — 1 






o 




o' 




O 


+ 


bO 


+ 


o 




1 — 1 


o 


1 — 1 






C 




O' 






o 




O 






Jh 












1 — 1 


















1 — 1 


o 










bO 


1 1 


1 — 1 


rH 


1 — 1 


O 


a 


Q. 




bO 




1 


1 


+ 


1 — 1 


H- 


1 1 


( — 1 


rH 


rH 










1 O' 


H- 


rH 






O 


1 — 1 


a 


1 1 


1 — 1 


a 


O' 


1 


cr 


o' 




o 


i—j 


o 


o 




a 




Q. 


a 






o 










Q. 








CM 




















r — 1 




1 — 1 


1 — 1 




bO 


1 — 1 


a 


a 


CM 


1 — 1 


1 — 1 


Q. 


rH 


rH 


1 Q. 




O 


O' 


O' 




H- 


a 


O 


o 






1 — 1 




Q. 


a 






Q. 








CM 


j — 1 


o 


rH 


CM 



I I 



II 



C\J 





( — 1 






rH 




a, 






Q. 


m 


cr" ° 


O 


O 


rH 

O' 




o 






O 




Q. 






a 



y — -X 








1 — 1 






1 — 1 


a 

1 


1 — 1 


( — 1 


a 

1 


rH 


Q. 


Q. 


rH 


-=r ^ 


J7^ o 


1 — 1 






o' ^ 


O' 




1 — 1 


o 


o 


1 — 1 


o' 


Q. 


Q. 


cr 


o 






o 


Q. 






a 





N 










1 — 1 




rH 


y— S 


o 


Q. 




a 


o 


Q. 


1 


( — 1 


1 


Q. 


1 


1 — 1 


a 


rH 


1 


cn rH 




o 





rH 






Q. 




— ' 




1 — 1 


CM 


1 — 1 




1 — I 


cr 




cr 


rH 


cr 


o 




o 


cr 




Q. 




a 











rH 


1 — 1 








rH 


Q. 


cr 






rH 


cr 


O 


o 


1 — 1 


CM 


cr 


o 


a 


a 


cr 


1 

1 — 1 


a 

1 


CM 


1 


1 








rH 


1 

1 — 1 


( — 1 


1 — 1 



C\l I — I O I — I C\J 

I I 



II 

CQ 
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Here, is the probability that the experiment ends at 

level j given it starts at level i and b. . is the probabil- 

^ J 

ity that the experiment requires j trials given it starts 
at level i. Note that A has the reflective symmetry prop- 
erty earlier defined for the P matrix and that B is 
symmetric with respect to its center row. 

Next consider the asymptotic properties of A and B 
as k increases without bound. First note that the non-zero 
elements of each are exponential functions in k. Since 

p., q., and g. . for j 7^ i are tail probabilities of 
1 1 1 3 J 

binomially distributed variables and thus approach zero as 
k gets large, it is seen from ( 24 ) and ( 25 ) that 



11 m A = P* = A* 


k-voo 







1000 




1000 


lim B = 


1000 


k^oo 


1000 




1000 



where P* is given by (I6). The positive elements in A* will 
be referred to as the limiting "diagonal" of A. Intuitively, 
these results imply that as the number k, of observations 
per trial is increased; the level of the estimated mean j , 
becomes the starting level i, for all levels leT-^^ except 
1 = ±u, and the number of trials becomes the lower bound 
n* of N*. Note that these Implications are consistent with 
the interpretation given for P*. 

In practice A* and B* are of little Interest since there 
is usually a physical or monetary constraint on the number 
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of observations which can be taken. A property which may 
be of Interest however is the rate at which A and B approach 
their limiting forms. If 



Ai(k) = (A^ a.j 


(k)). 


(28) 


•H 

<3 

II 

1 — 1 


(k)). 


(29) 



where (k) is the receeding difference of x^^j(k) with 

respect to k 

\ ='ij<k) = X^j(k) - (k-1) 

then it can be shown that 



lim 

k-^<=° 



A. 



0 



(30) 



lim 

k->co 



B- 



0 . 



(31) 



Furthermore, there exists a k' such that for k>k" the ele- 
ments of A on the limiting diagonal are increasing to one 
while all the other elements of A are decreasing to zero. 
Likewise, the elements of the first column of B are strictly 
increasing to one while all other elements are at zero or 
decreasing to zero. 

While the results of this section hold specifically 
for procedures in and the estimator defined by (l8), 
it is believed that similar results can be obtained for 
other procedures in defined by W(6^, k, 0, 1). That 
is, a change in the stopping rule 6^ to permit more trials. 



should not alter the result that as k Increases the level 



of the estimated mean approaches the starting level of the 
experiment and that the number of trials approaches the 
lower bound permitted by the stopping rule. 

In a later section, the efficiency of alternative pro- 
cedures In will be examined at which time there will be 
occasion to refer to some of the results obtained above. 



III. EFFICIENCY OF THE GENERAL PROCEDURE 



In this chapter, a methodology for evaluating alter- 
native procedures in the class will be discussed. A 
loss plus cost objective function is used with an appropr- 
ate criterion to determine an optimal procedure in a 
manner analogous to Wald's decision problem [171 where 
the space of terminal decisions is W, the finite set of 
equally spaced levels. No attempt will be made to deter- 
mine the optimal procedure in Q , rather it is assumed 
that a finite number of procedures in , say f, are to be 
evaluated and compared. 

Recall, an experiment ends at some level M in 77? when 

/s 

m^, determined by use of Y, is at level M. Suppose there 
exists some procedure W* in <2 , not necessarily in f the 
set of procedures being evaluated, whose use will almost 
surely cause the experiment to end at level 0, the level 
of the true mean. Then W* is preferred to a procedure 
which results in the experiment ending at level j, j 5 ^ 0 . 

Let H = h(J)(j = 0, ±1, ..., ±u) be an integer valued 
function which gives the loss incurred when the experiment 
ends at level j. Note that h(M) is a random variable. 
Since it is preferred that the experiment end at level 0, 
the loss h(0) can be taken as zero. The structure of the 
loss function may be known or its form assumed. Indeed, 
the nature of the random variable having the distribution 



G or the Intended use of , the estimated mean, may suggest 
an appropriate structure. If the structure of the loss 
function is unknown, one of several empirically derived 
loss functions might be used. For instance, one which is 
frequently cited in the literature is quadratic in the 
distance between the estimate m^ and the true mean m^ [17] . 
In this case, 

h(J) = n(j-O)^ = nj^, (32) 

where n is an Integer weighting factor, might be used. 
Suppose the cost of experimentation is known; that is, there 
is some constant cost, called the "set-up" cost which is 
independent of the number of observations taken, and some 
variable cost, dependent upon the number of observations 
taken, both of which are known. Without loss of generality 
define h(J), often called the cost of mlssclasslflcatlon , 
in units of the cost of observations and take the "set-up" 
cost as zero. Then the total loss incurred L, is given by: 

L = H + N, (33) 

where L is also in units of the cost of an observation. 

In the next two sections the problem of choosing an 
optimal procedure W* from a set of alternatives f is con- 
sidered, first using criteria based upon the expected value 
of the total loss and then using criteria based upon the 
variance of the total loss. Finally, the results of the 
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chapter are extended to the special case discussed In the 
preceedlng section. 

A. CRITERIA USING THE EXPECTED VALUE OF THE LOSS 

Given a particular procedure, W In I, If an experiment 
Is performed a large number of times and the loss evaluated 
by (33); then the expected value and variance of the average 
total lossjc^^, are given by: 

E [^^]= E [L] 

Var ^ Var [L] , 

where v Is the number of replications of the experiment 
[13] • These results express the principle of the law of 
large numbers In that as v Increases to Infinity the vari- 
ance of the average total loss goes to zero. Furthermore, 
the average total loss Is approximated by the expec- 

tation of the total loss, given by 

E [L] = E [H] + E [N] . (3^) 

An expression for (3^)> the expected total loss, which 
depends upon the prior distribution of Q, and A and B 
matrices discussed In the previous chapter, the loss 
function h and the range of N will now be derived. 

Let F In be the distribution function of the random 
variable Q with mass function f(l) denoting the probability 
that the experiment starts at level 1 (1 = 0, ±1,..., ±u). 
Here Q Is a set of distribution functions, the elements of 



which, in general, are not completely specified. Let q in 
be a L X 1 column vector whose i-th component is a prior 
estimate of f(i); that is, q represents a prior distribution 
on Q. Then the mass function of the random variable M is 
given by 



g]V[ (j) = q" A; (35) 

that is, gjy[(j) is the probability that the experiment ends 
at level j ( J = 0 , ± 1 , . . . , ± u) . If h^ is an I x 1 column 
vector whose j-th component is the loss h(j) Incurred when 
the experiment ends at level j , then 

u _ _ 

E [H] = Z gjv, (j) h (j) = q" A h^ . (36) 

j=-u 

Similarly, the mass function of the random variable N 
is given by; 

gj^ (n) = q" B, (37) 



where gj^(n) is the probability that the experiment ends 
after n observations (n = n^^,..., n^). If n^ is a 
(ny - n^ + 1) X 1 column vector. 



>^1 = 



n. 



n 



U 



then the expected number of observations is given by: 

n. 



E [N] = Z 



U 



n=n. 



?y(n) • n = q" B n^. 



(38) 
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Hence, using (36) and (38) j the expected total loss 



given in (3^) can be written 



E [L] = q' (Ah^ + Bn^) = r; 



( 39 ) 



where 



r=Ah^+Bn^=E [L/Q] 



(^ 0 ) 



is a X 1 vector of conditional expected total losses. 
Note that the components of r depend upon W. In fact (40) 
represents, using Wald's notation [17] j a vector valued 
function 



the i-th component of which is the expected total loss 
(risk) given the experiment starts at level i; i = 0, 
±l,...,±u. Likewise the expected total loss is equivalent 
to Wald's average risk function [171] that is. 



Note that in case there is no loss associated with an 
experiment that ends at level j (that is, h (j) = 0, for 
all J), then (39) reduces to the expected number of obser- 
vations given by (38). Given a prior distribution on Q, 
it is clear that the expected loss may be determined from 
(39) for each procedure W in f , The remainder of this 
section is devoted to a consideration of decision criteria 
that might be used in finding the best procedure in F. 



r = r (W) 



(41) 



E [L] = q" r = r* (q, W) . 



(42) 



1 . Bayes Procedure 



A procedure W* In F which minimizes the expected 
total loss over all W in F may be regarded as an optimal 
procedure [171. More precisely a procedure W* such that 

E [L] = r* (q,W*) = r* (q,W), (^13) 

is called a Bayes procedure in F relative to q. Thus, if 
prior Information on the distribution F exists and is known 
to the experimenter, he may evaluate alternative procedures 
in the set F using the Bayes criterion as a measure of the 
optimal procedure's efficiency. Such conditions may arise, 
for example, as a result of pilot testing. Indeed, in the 
elevation procedure of the field artillery precision regis- 
tration technique, discussed in IV, it is often possible to 
obtain such information. Note that in case the distribution 
F is such that the experiment starts at some level 1 with 
probability one, that is, if 

q = e . 

where e^ is a il x 1 column vector having one as its 1-th 
component and zero elsewhere, then (39) becomes 

E [L] = e^" r = r^ (i=0, ±1,..., ± u) . 

The set of vectors defined by (44) is called the set of 
unit vectors in Euclidean il-space and will be denoted 
q e E^. 
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2. Minimax Procedure 



A procedure W* in F such that 

E [L] = r*(q», W* ) = jjjj? r»(q, W) (45) 

is called a minimax procedure [171 • In some circumstances, 
particularly if the prior distribution on Q is not known, a 
minimax procedure may be regarded as an optimal procedure. 
Here one first determines for each W a vector q (a distri- 
bution) which is most unfavorable (that is, results in the 
largest expected loss) and then chooses W* to minimize the 
effect of the unfavorable distributions. 

B. CRITERIA USING THE VARIANCE OF THE LOSS 

Now suppose some procedure W in F is known to be optimal 
with respect to one of the criteria discussed in the previous 
section. In some circumstances, W may be the optimal pro- 
cedure for performing the experiment. But in other circum- 
stances, it may be useful to know the variance of the total 
loss , 



Var [L] = Var [H] + Var [N] + 2 Cov [H, N] , (46) 

where Cov [H, N] is the covariance of the random variables 
H and N, before the "best" procedure can be selected. An 
expression for the variance of the total loss, similar to 
the matrix equation given by (39) for the expected total 
loss, will now be derived. 



Let h 2 be a ii X 1 column vector whose j-th component 
2 

Is [h (j)] ; that is, the square of the loss incurred when 

the experiment ends at level j (j = 0 , ± 1 , . . . , ± u) . Let 
n^ be a (n^ - n^^ + 1) x 1 column vector, 

(Hl)2 

It follows that the second moments of H and N, respectively, 
are : 




E [H^] 


u 

= Z 


gjvjCj ) [h(j)] ^ = q" A h2. 


(47) 




C_i. 

II 

1 




E [N^] 


II 


2 — — 
gf^(n) n = q" B n^ , 


(48) 




II 





where use is made of (35) and (37)» Hence the variance of 
H, using (47) and (36), can be written in matrix notation 

Var [H] = E [H^] - [H] 

= Ahg - q^ Ah^h^ A^q . (49) 

Likewise, the variance of N can be written as 

Var [N] = E [N^] - E^ [N] 

= q' Bn2 - q'' Bn^n' B^q, (50) 

upon substitution of (48) and (38). 

The covariance of the random variables H and N is given 
by 
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Cov [H, N] = E [HN] - £ [H] * E [N] , 



(51) 



where the second term on the right hand side of is known; 
that is, using ( 36 ) and ( 38 ) the product of the expected 
values of H and N can be written in matrix notation, 

E [H] • E [N] = q' Ah^n^ q. (52) 

The product moment E [HN] can be found from the joint con- 
ditional probability mass function of the random variables 
M and N, given the random variable Q. Recall f„^ », i^(i nil) 
gives the probability that the experiment ends at level j 

after n observations, given it starts at level i. It 

follows that the conditional product moment of H and N, 
given Q can be written: 



E [HN|Q = 1] 



u Hl 

2 E n 

j=-u n=nT 



^M,N|Q ^J'>^|i)’h(j), (53) 



for 1 0, +l,...,±u. Denote by C = ( c^^^ ) a £ x £ matrix , 

called the Product Moment Matrix, where: 

°ij ’ ^m,n|q (J> t^|i) > 

L 

then the conditional product moment of H and N, given Q is 
the scalar product of the i-th row of C, denoted C^, and 
the vector h^ . That is, equation 53 becomes 

E [HN|Q = i] ^ Cj_h^, 

and It follf.w that 



0 



E [HN] 



( 54 ) 



u _ _ _ 

= T. Pr (Q=i) * = q' Ch^. 

i = -u 

Thus, (51), the covariance of H and N, can be written 

Cov [H, N] = q' Ch^ - q'Ah^n^ B"q (55) 

The variance of the total loss, equation 46, can now 
be written In matrix notation using (49), (50), and (55)* 
After some rearrangement of terms one obtains 

Var [L] = q' (Ah^ + Bn 2 + 2Ch^) 

- q' (Ah^h^" A' + Bn^n^^ B' + 2Ah^n£ B')q 

=q"c-q"Dq, (56) 

where 

c = Ah 2 + Bn 2 + 2Ch^ 

Is, a ^ X 1 vector and 

D = Ah^h^ A'+ Bn^n^ B'+ 2Ah^n^ B' 

= (Ah^ + Bn^) (Ah^ + Bn^)^ 

= r r' (57) 

Is a iJ. X A matrix and r Is the A x 1 vector of conditional 
expected total losses defined by (40). 

From (56) and (57), It Is seen that the variance of the 
total loss Is easily determined for a particular procedure 
W In r given a prior distribution on Q and the r vector. 
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But again one is confronted with the problem of choosing 
an appropriate criterion. Two criteria which may be used 
with (56) are considered below. 

1 . Minimum Variance Procedure 

A procedure in F such that 

Var [L] = V* (q, W*) = v* (q, W) (58) 

will be called a minimum variance procedure in F relative 
to q. Here, perhaps a certain amount of liberty has been 
taken in that ( 58 ) is defined analogous to (^ 3 ) and thus W* 
might appropriately be called a Bayes variance procedure. 

An analogy also exists with minimum variance estimators in 
statistics which appears to be more related in the context 
used here, so that the first mentioned terminology will be 
used. Hence, if a prior distribution exists and is known 
to the experimenter, he may, as when working with the Bayes 
criterion, evaluate alternatives in F using (58) as a 
measure of the optimal procedure's efficiency. Note that 
if q is a unit vector as defined by ( 4 ^ 1 ), then (56) can be 
written 



Var [L] = e^c - e^Dep 

= ^1 - dpp ( 1 = 0 , ± 1 ,..., ±u). 

2 . Minlmax Variance Procedure 

Consider the variance of the total loss given by 
equation 56 above. It is known [ 10 ] that (56) is convex 
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or concave depending upon whether the matrix of the quad- 
ratic form, -D, is positive semidefinite or negative seml- 
deflnite. Hence, it must first be established that the 
matrix D is positive semidefinite before discussing 
maximization of (56) with respect to q. 

In (57) > it is seen that D = r r'. Since r is a x 1 
vector, its rank is 1 < £ and it follows that D is a posi- 
tive semidefinite, symmetric matrix, and is singular [91. 
Hence, -D is negative semidefinite and the quadratic form 
given by (56) is concave. 

Now consider the quadratic programming problem of find- 
ing a q* which 

maximizes q^ c - q^ Dq 
subject to q^ 1 = 1 

(59 

q ^ 0 

where 0 is the zero vector and 1 = ( 1 ,..., 1 )^. Since the 
set of feasible solutions form a convex set and the objec- 
tive function is concave, it is known from the theory of 
convex functions [10] that any relative maximum is also a 
global maximum. (In this case the global maximum is not 
unique since the quadratic form is not strictly concave.) 
Thus if a feasible solution to (59) exists, one may find 
a prior distribution q* which maximizes the variance of 
the total loss, given by (56). Note that if q is a unit 
vector, then the solution to (59) may involve integer pro- 
gramming techniques since it must be true that q^ = 1, 
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q . = 0 for all j 7^ i to satisfy the constraints of the 
J 

problem. 

An additional criterion may now be defined. A pro- 
cedure W* In r such that 

Var [L] = V* (q*,W*) = (q" c - q " Dq) (60) 

Wei qep 

will be called a mlnlmax variance procedure provided a 
feasible solution to (59) exists. 

For a detailed discussion of techniques which can be 
used In solving (59) the reader Is referred to Hadley [10]. 
It should be noted that maximization of (59) may be facili- 
tated by the transformation 

q = R"z 



where R Is a £ x £ non-singular matrix such that 



RDR" = 



1 0 . . . 0 

0 0 . . . 0 



0 0 ... 0 

The reader Is referred to Anderson [1] for proof that R 
exists and a method for Its construction. 



C. THE SPECIAL CASE 

In the special case, development of the expressions for 
the total loss, the expected total loss and the variance 
of thie total loss follow arguments similar to those given 
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above for the general case. The arguments are not repeated 
here; rather differences In the resulting expressions as 
a consequence of (12) are noted. 

The total loss is given by 



L = H + kN*. 



(61) 



If n * is a (n* - n* + 1) x 1 column vector 
-L U -L> 



n’ 



n* = i . 
1 I 



n 



U 



and n* is a (n* - n* + 1) x 1 column vector 
<— U 






2 . 









then the expressions for the expected value and variance in 
the number of trials can be obtained by substituting n* 
for n^ and n* for n^ in (38) and (50), respectively. The 
expected total loss is 



E [L] = q' (Ah^ + kBn|) = q^r. 
And the variance of the total loss is 



( 62 ) 
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Var [L] = Var [H] + Var [N*] + 2k Cov [H,N*] 

= q" (Ah^ + k^Bn* + 2kCh^) 

- q" (Ah^h' A'+k^Bn*nJ" B"+2kAh^n*' B")q 

= q" c - q" Dq ( 63 ) 

where in this case the covariance of H and N* is obtained 
from (53) - (55) j substituting n* for n^, 

c = Ah 2 + k^Bn| + 2kCh^, 

D = (Ah^ + kBn*)(Ah^ + kBn*)". 

Obviously, one of the criteria defined by (^3)> (^5) or 
( 58 ), ( 60 ) can also be used In the special case. The 
problem, once one of these criteria has been selected, 
reduces to one of evaluating (62) or ( 63 ) for all procedures 
under consideration and then selecting the procedure which 
best satisfies the chosen criterion. 

In the remaining paragraphs of this section, the specific 
example introduced in Chapter II will be continued. First, 
It will be shown that the Bayes procedure In the set can 
be found by analytical methods. Then an evaluation of some 
of the procedures In will be discussed. 

1- Finding the Bayes Procedure Given the Triplet 
( 7/; , W , Y ) 

Consider the set of procedures defined by 
V/(6^, k, 0, 1) on 77/ = (-2, -1, 0, 1, 2} Introduced In 
II B 2. Recall the rule 6^ is to stop the experiment after 
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both responses and nonresponses have been obtained at two 
successive levels and that N*e {2,..., 5) • 

For this set of procedures, the experimenter might like 
to know If there exists a number k*, of observations per 
trial which minimizes the expected total loss given by (62) 
for a given prior distribution and loss structure. For 
example, he may be faced with a constraint on the number of 
trials for the experiment rather than on the total number of 
observations. Such a situation may arise, for example, when 
there Is a significant time lapse before response data can 
be observed. At any rate, a procedure with k* observations 
per trial is a Bayes procedure. To see this, note from (62) 
and (42) that 

E [L] = q' (Ah^+ kBnJ) = r* (q, W) . 

Since k Is the only unknown In W(6^, k, 0, 1), It follows 
from (43) that the procedure W(6^, k*, 0, 1) is a Bayes 
procedure. The experimenter may also be Interested In 
knowing if there is a relationship between the number of 
observations per trial and magnitude of the loss incurred 
from making a wrong decision. For example. If it Is pos- 
sible that the loss might be higher than he anticipates, he 
may be Interested In knowing whether he should take a 
larger or smaller number of observations per trial. 

For definiteness, suppose that the loss function Is 
the quadratic function given In (32). Then the expected 
total loss can be written 
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(64) 



E [L] = q' ( n Ah^ + kBn*) 



where 



h 



1 




(65) 



and A and B are given by (24) and (25) respectively and n 
is a loss parameter which determines the magnitude of the 
loss. The Bayes procedure may be found by minimizing (64) 
with respect to k ^1. 

Since it is assumed that q, the prior distribution of 
Q is given, it is sufficient to consider minimization of 
the components of the vector r, of conditional expected loss, 



r = r (k, n) = nAh^ + kBn* 



( 66 ) 



Note that the components r can be made arbitrarily large for 
a given n by choosing k large; that is 



lim — _ lim 

\^~yoo 



/ 


1 




2 






1 




2 




< n 


0 


+ k 


2 


> 


i 


1 

1 




2 






1 




2 






— 






1 



> 



(67) 



where use has been made of (26), (2?) and (65). Next, con- 
sider minimization of r. Differencing (66) with respect to 
k yj.r->ids 
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( 68 ) 



(k, n) = nA^(k) + kB^(k) n* + B(k-l) n* 

where A^(k) and B^(k) are defined by ( 28 ) and (29) res- 
pectively. It can be shown that If n = 0, then 



for all k ^ 1; and If n > 0, then the existence of k* > 1 
which minimizes r depends on the magnitude of n. Thus, In 
this example, the conditional expected loss Is minimized 
by taking k = 1 when n = 0 or by finding k* > 1 If n Is 
sufficiently large. For k > k*, r Is Increasing In k. In 
fact, here 



where use Is made of (30), (31)> and the fact that 

kB^(k) = 0. Given that Q = 1 and n Is sufficiently 
large, k* Is that k which satisfies, 

Aj^r^ (k, n) < 0 

Ak^"! (k + 1, n) > 0. 

Now consider the change In (68) as n changes 



It can be shown that there exists a k' such that for k > k^. 



(k, 0) > 0 




2 

2 

2 



2 



2 
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a result which implies that the expected loss can be 
decreased for high loss structures by increasing the number 
of observations per trial. 

It follows from the above that for the set of pro- 
cedures defined by W(6^, k, 0, 1) and a quadratic loss 
function that the existence of an optimal number k*, of 
observations per trial depends only on the magnitude of the 
loss which may be Incurred from deciding that the mean of 
the distribution being sampled Is at some level other than 
zero. That Is, If there Is no loss Incurred by this 
decision, then one observation per trial should be taken; 
otherwise more than one observation probably should be 
taken. Also, It was shown that choosing W In by finding 
a number k*, of observations per trial which minimizes the 
expected total loss is equivalent to finding a procedure 
which satisfies (^3), the Bayes criterion. 

Comparing procedures in the set f^, discussed above, 
with Tsutakawa's procedures has been avoided because of 
the limitation imposed by the stopping rule 6^, a rule 
selected because of its simplicity and applicability to 
the elevation procedure of the field artillery precision 
registration discussed in Chapter IV. Using the rule 6^, 
it is noted that the up-and-down method (that is, k = 1) 
does not perform well when compared to procedures in 
with k > 1 . It will be seen in IV that its performance is 
considerably better under a more liberal stopping rule. 
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Indeed, a limitation in evaluating procedures of the 
special case is the fact that comparisons are made over 
procedures where the total number of observations (sample 
size) varies drastically. As mentioned earlier, this 
situation may be realistic if the experimenter is faced 
with a constraint on the number of trials rather than the 
total number of observations. 

It appears that, in the special case, whether or not 
there exists a number k* > 1 of observations per trial 
which minimizes the expected total loss depends upon the 
nature of loss function and the stopping rule, 6. While 
the results of this section hold specifically for the stop- 
ping rule 6^ and the estimator defined by (l8) it is anti- 
cipated that similar results should be obtained for 
stopping rules which permit a larger number of trials and 
other estimators. 

2. An Evaluation of Some Procedures in 

In order to illustrate the techniques of evaluation 
which have been discussed, it was decided to evaluate the 
loss characteristics for some procedures in 1^ using data 
generated by a high-speed dldgltal computer. Recall that 
is the set of procedures considered in the example intro- 
duced in section II B 2 and continued in the preceedlng 
section. A computer program (see page 127) was written in 
FORTRAN IV and ran on an IBM 360 computer for k = 1,..., 6, 
two loss functions, four values of the loss parameter, and 
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the set of prior distributions e^ in E, i = 0,±1, ±2. 
Output from the program is arranged as follows: for each 

value of the number k of observations per trials the A and 
B matrices are followed by matrices showing the expected 
value and variance of the total loss given q = e^ in 

i = 0, ±1, ±2 (see page 100). In the remainder of this 
section, the results of the evaluation will be discussed. 

Tables I and II show the optimal procedures in (that 
iSj optimal number k, of observations per trial) for the 
criteria based upon the expected value and variance of the 
total loss, respectively, when the loss function is either 
linear or quadratic and the loss parameter, n , has the value 
Indicated. In Table I, note that when n = 0, k = 1 is 
optimal; but when n > 0, k > 1 is optimal. Note also that 
using criteria based upon expected loss, the ordering among 
alternative procedures is independent of the two loss struc- 
tures used for the values of n considered. On the other 
hand, from Table II, it is seen that use of variance cri- 
teria is very sensitive to the loss structure. For linear 
loss structures , variance criteria tend to Indicate fewer 
observations per trial when compared to expected loss 
criteria and vice versa for quadratic loss structures. In 
general, the minimax criterion indicates optimality for 
procedures with a smaller number of observations per trial 
than the Bayes criterion relative to starting at level 0. 

In other v/ords , as anticipated the mlnlmax procedure was 
found to be protective against a high loss resulting from 
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OPTIMAL PROCEDURES (NUMBER OF OBSERVATIONS PER TRIAL) 
USING EXPECTED LOSS CRITERIA 
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NOTE: The notation 2 (±2) means that a procedure with two observations per trial is 

— S 

optimal relative to the prior distributions e. e E , for i = ±2. 
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NOTE: The notation 1(±2) means that a procedure with one observation per trial is 

optimal relative to the prior distributions e. c for i = ±2. 



starting away from level 0. On the other hand. It seems 
more difficult to explain the relation between the mlnlmax 
variance criterion and the minimum variance criterion. 

For a linear loss structure, the mlnlmax variance criterion 
Indicates optimality for a procedure with one observation 
per trial which. In general. Is also Indicated by the 
minimum variance criterion relative to starting at level 0. 
But for a quadratic loss structure, the mlnlmax variance 
criterion. In general, was found to be protective against 
high variances resulting from starting away from level 0. 

Recall that the technique used In the preceedlng section 
to show how the Bayes procedure could be found analytically 
consisted of minimizing (66) with respect to k. Figures 2 
and 3 show the expected value of the loss, given the experi- 
ment begins at level 0, as a function of k and n for quad- 
ratic and linear loss structures. Note the Increases which 
occur at k = 4 . These anomalies are a consequence of (19); 
that Is, the fact that level 0 Is by definition the midpoint 
of the open Interval (-5^, ^).^ Note: the minima Indicated 

by the curves correspond to the optimal Bayes procedures 
relative to e^ In which are Indicated In Table I; the 
curves for n = 0 are strictly Increasing; the curves are 

9 

It turns out that go i, given by (23), Is significantly 
higher for k = than It is for k = 5 (approximately 0.12 
as compared to 0.06). Thus If k = 4 and the experiment 
starts at level 0 there Is a higher probability, relative to 
k = 3 or 5 > that the experiment will end at some level other 
than level 0. The resulting effect Is a higher expected 
loss for k = 4 . 
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Expected Value of the Total Loss Given 
the Experiment Begins at Level 0 




k. Number of Observations per Trial 



Figure 2. Expected Value of the Total Loss Given 

the Experiment Begins at Level 0 as a Function 
of the Number of Observations per Trial and 
the Magnitude of the Loss Parameter n for 
Procedures W(6,,k,0,l) and a Quadratic Loss 
structure . 
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Expected Value of the Total Loss Given 
the Experiment Begins at Level 0 




k. Number of Observations per Trial 



Figure 3- Expected Value of the Total Loss Given 

the Experiment Begins at Level 0 as a Function 
of the Number of Observations per Trial and 
the Magnitude of the Loss Parameter ri for 
Procedures W(6^,k,0jl) and a Linear Loss 
Structure . 
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asymptotic to the line = 2 k, an asymptote suggested by 
(67); and the slopes of the curves, in general, are decreas- 
ing for higher values of n» 

The results from the evaluation of some procedures in 
are helpful in several Important ways. First, they tend 
to validate the evaluation methodology presented earlier; 
that is, the results were consistent with expectations. 
Secondly, they give insight into the selection of one of 
the criteria discussed, and lastly, some consequences of 
the model have been brought out; for example, it might be 
that level 0 should be defined as the midpoint of a closed 
Interval . 
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IV. APPLICATION TO THE ELEVATION PROCEDURE OF 
THE FIELD ARTILLERY PRECISION REGISTRATION 



Field artillery weapons are normally positioned so that 
muzzle blasts from the weapons cannot be seen by ground 
observers of an opposing force. As a consequence, projec- 
tiles fired from the weapons must be fired at targets which 
usually are not visible from the weapon position. Fire 
delivered under these circumstances, normally from weapons 
having a relatively low muzzle velocity, is called indirect 
fire. Given the location of the weapon, the location of 
the target, and ballistic data based upon standard weapon- 
weather-ammunition conditions, one can compute firing 
data — direction (called deflection), elevation angle, and 
ammunition fuze setting — which under standard conditions 
will cause the mean point of impact of the projectiles to 
be oh the target. In practice, standard condltons rarely 
exist and there are usually some location and delivery 
errors. Thus, if a number of projectiles, later referred 
to as rounds, is fired at a target using standard data and 
the mean point of Impact is determined, there is some 
cummulatlve error due to nonstandard conditions which causes 
the mean point of impact to be away from the target. The 
precision registration technique is one method which is 
used by U.S. Army and Marine Corps field artillery units 
to determine the magnitude of a correction for this error. 
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A precision registration is performed to determine, by 
adjustment, the firing data which will cause the mean point 
of Impact of a group of rounds to be at a point of known 
location, called the registration point [7] • Note that 
this is at least a two dimensional problem. An adjusted 
deflection and elevation must be determined and if an 
adjusted fuze setting is desired so that air bursts are 
achieved, then it becomes three dimensional. Since the 
discussion ultimately concerns only the adjusted elevation 
it is assumed in that which follows that an adjusted fuze 
setting is not desired. In a precision registration, firing 
is conducted in two phases using only one weapon. In the 
first phase, called the adjustment phase, the objective is 
to adjust the mean center of Impact of a group of rounds to 
within a specified distance of the registration point. 

This is accomplished by use of an observer who determines 
corrections and transmits them to fire direction personnel. 
Normally the observer uses a bracketing procedure. In the 
second phase, called the flre-for-ef feet phase, a number of 
rounds is fired to permit refinement of the mean center of 
Impact. Here the observer transmits quantal response data 
only; that is, he observes where the round bursts in rela- 
tion to the registration point and transmits this informa- 
tion to fire direction personnel. The number of rounds used 
in the flre-for-ef feet phase varies randomly and the phase 
ends v/hen a set of decision criteria are satisfied. 
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Note the similarity between the flre-for-ef feet phase 
of the precision registration and the bio-assay experiment. 
The first round fired in the flre-for-ef feet phase is the 
first trial of an "experiment" being performed to estimate 
the adjusted firing data. One cannot measure the set of 
"critical" firing data which causes the mean point of 
Impact to be at the registration point. He can only select 
a set of data and then observe where the round bursts in 
relation to the registration point. In addition, it is 
well known that if a large number of bursts is observed, 
then the distribution of the bursts about the registration 
point is approximately normal. Also, the variance is known 
from previous test firings. Hence, the fire-for-effect 
phase of the registration may be viewed as an experlment^^ 
to estimate the mean of a bivariate normal distribution 
having known covariance matrix. 

Separate procedures. Implemented simultaneously, are 
currently used to determine the adjusted deflection and the 
adjusted elevation in the fire-for-effect phase. One is 
not dependent on the other in that the adjusted deflection 
may be determined first, or vice versa. It thus seems 
reasonable to assume that the fire-for-effect phase consists 
of two Independent procedures. In that which follows this 
assumption has been made; that is, the elevation procedure 

^^Thus, when "the experiment" is referred to it is clear 
that what is meant is "the fire-for-effect phase of the 
registration . " 



71 



is viewed as an experimental procedure for estimating the 
mean of a univariate normal distribution. It is also 
assumed that firing is to be conducted at elevation angles 
less than 45 degrees, that there is Independence between 
bursts, and that the registration point is, in fact, a 
point on the real line so that the probability of hitting 
the registration point is zero. The purpose of this chap- 
ter is to show that the elevation procedure currently in 
use belongs, under the assumptions made above, to the class 
of sequential procedures , defined in I . A second purpose 
is to compare the efficiency of the current procedure with 
some alternative procedures in Q, . 

A. THE CURRENT ELEVATION PROCEDURE 

The current elevation procedure, later referred to as 
the "current procedure," will now be described within the 
framework of an experiment. The flre-for-ef feet phase is 
entered when it is determined that a correction given by 
the observer will move the burst within a specified distance 
of the registration point. The elevation determined from 
this, the observer's last correction, establishes the 
liitlal level of the experiment and the first trial is per- 
formed by firing one round at the registration point using 
the elevation corresponding to this initial level. If the 
first round bursts at a range greater (less) than the range 
to the registration point, it is said to be over (short) 
and the next level for the experiment is determined by 
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decreasing (increasing) the elevation by an amount which 
will move the mean center of impact four range probable 
errors. Succeeding trials of the experiment are per- 
formed by firing one round at succeeding levels until a 
burst is observed to be short (over). This establishes a 
one fork elevation bracket; that is, an over and a short, 
fired at levels one fork apart, have been observed. The 
next level of the experiment is the midpoint of the one 
fork elevation bracket, and the next trial is performed 
by firing three rounds at this level. If the majority of 
the bursts are over (short), then the last level of the 
experiment is the elevation corresponding to the short 
(over) end of the one fork elevation bracket and the last 
trial of the experiment is performed by firing two rounds 
at this level. 

In the experimental procedure Just described note 
that: the number N, of rounds fired is a random variable 

since more than two trials may be necessary to establish 
a one fork elevation bracket; the number k, of rounds fired 
per trial is not constant; and successive trials of the 
experiment are not performed at successive levels. Hence, 
the current elevation procedure of the field artillery 
precision registration technique is a member of the class 
of procedures Q defined in I and can be modeled by the 
general procedure W(6, k^ , C^) in . 

11 

One range probable error, PE^,, is approximately 0.67 
standard deviations. Pour PR^ is called a fork. 
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Let 1')]' = -1, 0, 1,...} be a set of equally 

spaced levels having interval m = 1/2 fork where the level 
0 corresponds to the registration point. Let 
7// = {- 3 ,..., be a subset of Tr')' . Then the current 

elevation procedure can be described as follows. The exper- 
iment (the fire-for-effect phase) begins at some (elevation) 
level in >7? with one observation on the first trial. 

Here, is in 7)\ because the adjustment phase does not end 
until the mean center of Impact is adjusted to within a 
specified distance of the registration point. An observa- 
tion is a response (an over) or a nonresponse (a short) 
depending upon whether the round bursts at a range greater 
than or less than the range to the registration point. 

If G is the distribution of bursts about the registration 
point when the mean point of impact is at the registration 
point, then the probability of a response at level j is 
G(J)j j = -3,.. .,3. This is just the probability that the 
adjusted elevation is less than the elevation used to 
perform a trial of the experiment at level j . The experi- 
ment continues at levels Y 2 ,...,Yj^*j with 
observations per trial, determined by: 



v/herc is the number of responses on the t-th trial and 



\h- 1 = h 

Y , - C, • m 

\ t t 




if 0 < Jt < 

if k^o < < k^ - k^°, t > 1 

‘^t - ^t° 1 Jt ^ ^t 



2 



3 



1 £ t £ n* - 

1 n*-2<t<n*-l 

fo l<t<n*-2 

I 1 t = n* - 1 

l£t£n*-2 
<3 t = n* - 1 

2 t = n* 

\ 

of integers. The rule 6 in W(6, k^, ^ 

is to stop the experiment two trials after the first rever- 
sal in the sequence of responses is obtained. For 

example, if = 0, J 2 = 0 and = 1, then two more trials 
would be performed and n* = 5. Note that since 1T\ = {-3, 
...,0,...,3} as few as seven rounds and as many as nine 
rounds may be required for the experiment since if it 
starts at level -3, as many as four rounds may be required 
to establish a one fork elevation bracket. 

When firing has been completed, the adjusted elevation 
is computed using the data from the last two trials and an 
earlier trial performed at the same level as the last trial 
Thus six observations are used from trials performed at 
two of the levels in TH ' . The adjusted elevation is the 
mean elevation fired to obtain this group of six observa- 
tions Y, plus an elevation change AY, determined by: 



"t = 



k. 



k. 



are sequences 



AY = - 



difference in 
2 X 6 (the 



number of overs and shorts fork 
number of observations) ^ 

(69 
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where the sign of the right side is negative because a 
positive difference in the number of overs and shorts 
indicates the mean elevation fired is greater than the 
adjusted elevation. Let A be the difference in overs and 
shorts, then (69) can be written 

AY = - ^ 

o 

where use has been made of the fact that m = ^ fork. Let 
be the total number of responses (overs), then 

A = - (6 - J^) = 2 - 6 

so that the adjusted elevation may be computed using the 
estimator 

/s n ^ 

Y = i 2 Y - I J + m (70) 

^ t=n*-l t j 1 

Note that if the total number of responses is three (that 
is, if there are three overs and three shorts), then the 
last two terms of (70) sum to zero. 

/s 

Given the triplet (77], W, Y) the procedure transition 
and Iteration matrices can now be determined from (10) and 
(11). Let Q be a discrete random variable with distribution 
function F which denotes the level Y^ in at which the 
experiment begins. Q is a random variable because Y^ is 
determined by a process of adjustment which is subject to 
random error. Indeed, if the interval m between levels in 
y7] is large, then the distribution may concentrate nearly 
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all Its mass at level 0. Let M be a discrete random 
variable which denotes the level in ~]T\ which represents 
the adjusted elevation. Recall from II, that ^ represents 
a finite set of midpoints of disjoint intervals, the union 
of which forms an open interval on the real line. Thus 
the adjusted elevation can be represented by one of the 
levels in W and the joint conditional probability 

n|l), (l,j = -3, . . . 0, . . . ,3; n = 7,8,9) that the 
experiment ends at some level j in 7fl after n rounds have 
been fired given it begins at level i, can be found using 
(7)j (8) and a logic tree similar to that shown in Figure 1. 
Let q, a (7 X 1) column vector of probabilities that the 
experiment starts at level i, be a prior distribution on Q. 
The i,j-th element of the Procedure Transition Matrix A 
(the probability that the registration ends at level j 
given the flre-for-ef feet phase begins at level 1) is 

9 

^ij " ^M,N|Q 

and the probability that the registration ends at level j , 
given by ( 35) , is 

Pr [M = j] = gj^(j) = q" A . 

Likewise, the l,j-th element of the Procedure Iteration 
Matrix B (the probability that the registration ends after 
j rounds have been fired, given the flre-for-ef feet phase 
begins at level 1) is 
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3 

m=-3 



(m, j I i) 



(72) 




M,N|Q 



and the probability that the registration requires j rounds, 
given by (37) is 

Pr [N = j ] = gj^( j ) = q" B. 

The current procedure can now be evaluated using a loss 
plus cost objective function in a manner analogous to 
Wald's approach. If H is a random variable which denotes 
the loss associated with a registration that ends at some 
level in 7// other than level 0 and the loss is measured in 
units of the cost of a round, then the total loss L, also 
measured in units of the cost of a round, is given by (33). 
That is. 



L = H + N. 

Here, other costs incidental to the experiment are assumed 
to be constant and thus may be neglected for purposes of 
this evaluation. It appears that (33) is a reasonable 
objective function for the elevation procedure of the 
precision registration. An adjusted elevation which makes 
the total loss as low as possible would be preferred. Con- 
sider, for example, the consequences of deciding that the 
adjusted elevation is at level -3- This means that subse- 
quent firing using the adjusted elevation as a basis for 
corrections will, on the average, be short by six range 
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probable errors, a situation that may be intolerable if 
fires are to be delivered close to friendly forces. Indeed, 
it is reasonable that, in certain circumstances, a high 
loss be associated with making such a decision. Although 
the nature of the loss function h(j) may not be known, one 
of several intuitively plausible loss functions may be 
used for the evaluation. This point will be considered 
below in more detail. 

If h^ is a (7 X 1) column vector whose j-th component 
is the loss associated with a registration which ends at 

level J and n^ is a (3 x 1) column vector, n^ = (7> 8, 9)', 

then the expected total loss, given by (39), is 

E[L] = q"(A h^ + B n^) 

where use is made of (35) and (37)- Likewise if h 2 is a 
(7 X 1) column vector whose j-th component is the square of 
the loss associated with a registration which ends at level j 
and is a (3 x 1) column vector = (^9, 6^1, 8l)^, then 
the variance of the total loss, given by (56), is 

V[L] = q" F - q"D q 

where c = A h 2 + B n 2 + 2C h^ is a (7 x 1) column vector, 

D = (A h^ + B n^)(A h^ + B is a (7 x 7) positive semi- 

definite symmetric matrix having rank one, and C h^ is a 
(7 X 1) column vector whose i-th component is the product 
moment of the random variables H and N given the experiment 
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starts at level 1. The reader is referred to III for a 
more detailed derivation of the variance of the total loss. 

Given the statistical properties of the current 

procedure can be determined using (71) and (72). For 
example, the probability that the procedure uses j rounds, 
given fire-for-ef feet starts at level 1 is given by (72). 

The efficiency of the procedure can be determined for any 
finite loss structure from (39) and (56). Further discus- 
sion of the current procedure will be deferred to a later 
paragraph where its properties and efficiency can be com- 
pared with those of two alternative procedures which are 
discussed in the next section. 

B. ALTERNATIVE ELEVATION PROCEDURES 

An elevation procedure which was used in the precision 
registration technique prior to 1965 will now be discussed. 
For convenience, this procedure will be referred to as the 
"old procedure." Essentially, the old procedure differs 
from the current procedure in that a one fork elevation 
bracket is not obtained prior to firing the initial group 
of three rounds and all subsequent firing is in groups of 
three rounds. That is, the first trial of an experiment 
performed with the old procedure begins at some level in 
with three observations. The experiment continues at 
levels Y 2 ,...,Y^^, with three observations per trial, deter- 
mined by: 
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+ m 



0 



t+1 



\ 



- m 



if = 1,2, 
if J, = 3 



t > 1 



where m = 1/2 fork and is the number of responses (overs) 
on the t-th trial. The experiment ends when both responses 
and nonresponses have been obtained on two successive 
trials. Note that the old procedure can be denoted 
W(6^, 3, 0, 1), a procedure In f^. Note also that 
6 £ n £ 21 since the experiment could conceivably start at 
level -3 and not obtain a response until level 3 Is reached. 
When firing Is completed the estimator given by (70), where 

n* 

Jm “ ^ -t- » 

^ t=n*-l ^ 



Is used to compute the adjusted elevation. 

A second alternative to the current procedure Is the 
modified up-and-down method with a "nominal" sample size 
of six described by Dixon [4]. This procedure will be 
referred to as the "blo-assay procedure." Under this pro- 
cedure, the experiment begins at some level with 

one observation on the first trial. The experiment con- 
tinues at levels Y 2 ,...,Y^j^, with one observation per trial, 
determined by: 



Y 



t + 1 




+ m 

- m 



If J. = 0 

, t > 1 

If Jt = 1 
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where m = 1/2 fork and Is the number of responses (overs) 
on the t-th trial. From II this procedure can be denoted 
where the rule 6^ is to perform four more 
trials after the first reversal in the sequence of responses 
{J^}. Here 6 _< n _< 11 because the first reversal could 
occur as soon as the second trial and as late as the seventh 
trial (that is, start at level -3) and not obtain a response 
until level 3 or vice versa) . Note that the rule 62 is 
more liberal than 6^^ in that its use permits four more 
trials (Instead of no more) after the first reversal. 

When firing is completed, the adjusted elevation is deter- 
ilned from the estimator 



Y = + Km (73) 

where Y^^ is the last elevation fired, k is a constant 
(see Table I of reference ^) which depends upon the sequence 
{J^} and m is the interval between levels. Equation 73 was 
empirically constructed by Dixon and is essentially equiva- 
lent to 



Y 



. n»+l 
^ t=n*-4 



3 



for a nominal sample size of six. Here, Y is the level 

n* + l 

that v;ould be used if one more trial was conducted. For 
example if m = 1, {Y^} = { 0 , 1 , 2 , 1 , 2 , 1 , 0} , and {J^ } = 

{ 0 , 0 , 1 , 0 , 1 , 1 , 1 } , then = -1 and Y = ^ while use of (73) 

gives Y = 0.732. 
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C. AN EVALUATION OP THE CURRENT ELEVATION PROCEDURE AND 
SOME ALTERNATIVES 

A comparison of the three alternative elevation pro- 
cedures described above Is presented In this section. For 
convenience the alternatives will be referred to as 
follows : 

A - The old procedure 
B - The blo-assay procedure 
C - The current procedure 

The objective function defined by (33) was used with two 
loss functions given by 



hi(j ) 


= nj^ 




(74) 




r nj^ 


1 — 1 
C\J 

on 

1 

II 




h.(j) 






(75) 




1 0 


otherwise 





where n is an arbitrary constant which determines the magni- 
tude of the loss. Note that h^ is both quadratic and sym- 
metric in J, while is asymmetric. The loss function 
which appears to be a reasonable when fires are to be 
delivered just beyond friendly forces, associates a high 
loss with the decision that the adjusted elevation is less 
than the true adjusted elevation and no loss with the con- 
verse decision. The criteria used in the comparisons are 
given by (43), (45), (58), and (60). 

A computer program, similar to that shown on page 127, 
was written in FORTRAN IV and ran on an IBM 360 computer to 
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evaluate equations 39 and 56 for the loss functions and 

and various values of the loss parameter. The set of 

— 7 

all unit vectors in Euclidean seven space, e^ in E , was 
taken as a set of prior distributions on Q. 

A summary of the statistical properties of the 
various procedures given that the f Ire-for-ef f ect phase of 
the registration begins at level 0 is given in Table III. 

The data in the table are the center rows of A and B 
matrices which are shown on pages II 8 , 121 , and 12 ^, respec- 
tively for procedures A, B, and C. The table is Included 
to permit an appreciation of the relative merit of the 
various procedures given the fire-for-ef feet phase starts 
at level 0. Data for other starting levels is contained 
in the other rows of the A and B matrices. The data con- 
tained in the table should not be used as a basis of 
deciding that a particular procedure is best; rather, one 
of the criteria discussed III A 1, III A 2, III B I, or 
III B 2 might be used. 

Computations of the expected loss and variance of the 
loss are shown for both loss functions and seven values of 
the loss parameter beginning on pages 119 , 122 , and 125 for 
procedures A, B, and C, respectively. The first column in 
each matrix, the expected loss and variance of the loss 
when the loss parameter n is zero, is equivalent to the 
expected value and variance of the number N, of rounds 
fired during the flre-for-effect phase. To see this, the 
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reader is referred to the discussion of the expected value 
and variance of the loss in III. Figure H shows plots of 
the expected value and variance of the total number of 
rounds as a function of the starting level. There, the 

— 7 

indicated Bayes procedure relative to e^ e E are: 

Procedure A for i = 0, ±1, Procedure B for i = ±2, and 
Procedure C for i = ± 3 * And the minimax procedure is C. 
Thus, if there is no loss associated with deciding that 
the adjusted elevation is at level M, it is seen that use 
of the current procedure gives protection against high 
losses resulting from staring away from level 0. This 
result is characteristic of a minlmax procedure. Notice 
that variance criteria provide different candidates for 
the optimal procedure. Procedure A is the minimum variance 

— 7 

procedure relative to eQ e E' while Procedure C is both 

_ 7 

the minimum variance procedure relative to e^ e E for 
1 7 ^ 0 and the minlmax procedure. These results are inter- 
preted to mean that, in the long run, the use of Procedure 
A or B may result in a smaller expenditure of ammunition; 
but, the use of Procedure C will result in a near constant 
expenditure of ammunition per registration. It is inter- 
esting to note the differences between Procedures A and C. 
Mote from Figure ^ that use of Procedure A results in a 
smaller expected number of rounds if the fire-for-ef feet 
phase starts at level 1, 1 = 0, ±1. In practice, however, 
the starting level cannot be fixed with certainty. In fact. 
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Q, The Level at Which the Fire-f or-Ef f ect Phase 
Starts (Spacing Between Levels is 2PE^) 



Figure Expected Value and Variance of the Number 

of Rounds Fired in Flre-f or-Effect for Procedures 
A, B and C as a Function of Starting Level (Here 
the Loss Parameter n is Zero). 
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the basis for adoption of the current procedure (C), was 
that an occasional observer error in the adjustment phase 
would, when using the old procedure (A) , result in an 
excessive number of rounds [l6] . While the results shown 
in Figure 4 substantiate this decision, the reader is 
reminded that here the loss parameter is zero; that is, to 
choose a procedure on the basis of expected value and vari- 
ance in the number of rounds may be equivalent to deciding 
that there is no risk associated with deciding that the 
adjusted elevation takes on some value other than the true 
adjusted elevation. 

Suppose the loss structure can be represented by h^, 
the quadratic loss function given by (7^). Figure 5 shows 
the expected value and variance of the total loss as a 
function of starting level for a quadratic loss structure 
when the loss parameter is 50. Note that Procedures A 
and/or B satisfy all of the criteria. Procedure A is both 
the Bayes and minimum variance procedure relative to 

— 7 

e^ e E for i = 0, ±1. Procedure B is the Bayes and minimum 

_ 7 

variance procedure relative to e^ e E for 1 = ±2, ±3. In 
addition. Procedure B is both the mlnlmax and minimax 
variance procedure, replacing Procedure C which satisfied 
these criteria under the no loss assumption. In fact, it 
appears that Procedure B gets "better" as the distance 
between the starting level and the registration point 
increases. This result is surprising and may be due to the 
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of Total E [L] , Expected Total Loss 

of Rounds (in Number of Rounds) 





Q, The Level at Which the Flre-for-Effect Phase 
Starts (Spacing Between Levels is 2PE^) 



Figure 5. Expected Value and Variance of the Total 
Loss for Procedures A, B and C as a Function of 
the Starting Level When the Loss Structure Is 
Quadratic and the Loss Parameter p Is 50. 
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use of (73) in computing the adjusted elevation. Note also 
the magnitude of the variance of the total loss. Table IV 
shows optimal procedures under the various criteria for 
the values of the loss parameter n considered when the loss 
structure is quadratic. It can be seen that for n > 10, 
the ordering among the alternative procedures is independent 
of the magnitude of the loss parameter n. Recall this was 
not true in III C 2 where evaluation of some procedures in 
r^, including Procedure A, was discussed. Here, this result 
essentially means that one need not be concerned with 
determining how large a loss may be suffered; rather he 
should deal with the more important issue of determining 
whether or not a loss will in fact be sustained and if so, 
whether or not a quadratic loss structure is appropriate. 

It should be noted that the result may not hold for higher 
values of the loss parameter. Another Interpretation of 
the data in Table IV is that Procedure B is more conserva- 
tive than Procedure A. This can be seen by noting first 
that Procedure B is, for p > 0 , both a minimax and minimax 
variance procedure, and that Procedure B is both a Bayes 
and minimum variance procedure relative to e^ e e'^ for 
1 = ±2, +3. In other words, use of Procedure B gives pro- 
tection against high losses and variances resulting from 
starting the fire-for-ef feet phase away from level 0. Note 
however that in case it can be assured that the flre-for- 
effect phase starts at levels 0 or ±1 (that is, within 3 PE^ 
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OPTIMAL PROCEDURES FOR A QUADRATIC LOSS STRUCTURE 
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NOTE: The notation A(0j±l) means that procedure A is optimal relative to the prior 

_ 7 

distributions e. e E , for 1 = 0,±1. 



of the registration point since level 1 is the midpoint of 
an Interval of length 2 PE^) then Procedure A is best for 
n > 10. 

Perhaps a more realistic loss structure in some cases 
is one which is asymmetric. If it can be represented by 
^ 2 ^ given by (75)j then the decision maker is confronted 
with a different situation. Recall the Interpretation of 
h 2 is that there is a high loss associated with deciding 
the adjusted elevation is less than the true adjusted ele- 
vation and no loss is associated with deciding that it is 
greater than the true adjusted elevation. Figure 6 shows 
the expected value and variance of the total loss as a 
function of starting level for an asymmetric loss struc- 
ture when the value of the loss parameter is 50. Note the 
trends in this situation. Procedure A varies widely depend- 
ing upon the starting level. Procedure B again appears to 
be better when the flre-for-ef feet phase starts away 
from the registration point, particularly from below . Pro- 
cedure C is fairly consistent at about midway between the 
extremes noted for Procedure A. Here also, Procedures A 
and/or B dominate Procedure C with respect to all the 
criteria. Note that both the expected value and variance 
of the total loss take on larger values than they did in 
the previous case. Table V shows the procedures which are 
optimal under the various criteria for the values of n 
considered when the loss structure is asymmetric. Note 
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ar [L] , Variance of the Total E [L] , Expected Total Loss 
Loss (in Number of Rounds) (in Number of Rounds) 





Qj The Level at Which the Pire-for-Effect Phase 
Starts (Spacing Between Levels is 2PE^) 



Figure 6. Expected Value and Variance of the Total 
Loss for Procedures A, B and C as a Function 
of Starting Level When the Loss Structure is 
Asymmetric and the Loss Parameter n is 50. 
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OPTIMAL PROCEDURES FOR AN ASYMMETRIC LOSS STRUCTURE 
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NOTE: The notation A(0j±I) means that procedure A Is optimal relative to the prior 
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distributions e. e E , for i = 0. ±1. 



that In this case the ordering Is also unchanged for 
h > 10. Again It Is seen from the data In Table V that 
Procedure B tends to be conservative. It Is Interesting 
to observe that If an asymmetric loss structure Is valid, 
then the expected value and variance of the loss can be 
greatly reduced by use of Procedure A and by assuring that 
the flre-for-ef feet phase always begins at a point beyond 
the registration point. 

In concluding, It should be emphasized that the purpose 
of this chapter has not been to select an optimal elevation 
procedure, rather to show how the current procedure can be 
modeled and to define Its degree of optimality by means of 
comparison with some alternative procedures. The current 
procedure was shown to be conservative under a no loss 
assumption; that Is, It was found to be a mlnlmax procedure 
when the basis of the evaluation and comparison was the 
expected number of rounds fired during the flre-for-effect 
phase of the registration. It was shown that If a loss 
structure exists and can be represented by either of the 
loss functions h^ or for 0 < p _< 50, then the current 
procedure Is not optimal with respect to any of the criteria 
considered. In particular. If the loss structures con- 
sidered are valid, then for p > 0 the blo-assay procedure 
strictly dominates the current procedure and the old pro- 
cedure dominates the current procedure relative to prior 
distributions e^ e e'^ for 1 = 0, ±1. These results 



95 



suggest that furthe: 
warranted. Indeed, 
procedure, to enter 
currently the case. 



study of the elevation procedure 
it may be possible, using the bio 
fire-for-ef feet more rapidly than 



is 

assay 

is 
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V. SUMMARY AND CONCLUSIONS 



A class of sequential procedures for estimating the 
mean of a normal distribution function with known variance 
from quantal response data has been discussed. An experi- 
ment conducted using a procedure belonging to the class is 
characterized by: 1) a random number of trials, 2) a 

number of observations per trial that is not necessarily 
constant throughout the experiment, and 3) a sequence of 
trials that are not necessarily performed successively at 
equally spaced levels. It was seen that the general pro- 
cedure W(6, C^), called a modified Tsutakawa ran- 

dom walk design, depends upon the stopping rule 6 and the 
sequences {k^°}, and (C^}. The class of general 

procedures was seen to include the up-and-down method and 
the Tsutakawa random walk design as special cases. Two 
matrices, the Procedure Transition Matrix and the Procedure 
Iteration Matrix, were found to characterize the general 
procedure. A technique of' evaluating the efficiency of 
the general procedure was presented which is essentially 
an application of Wald's decision theory. It was seen 
that a loss plus cost objective function can be used along 
with one of the four decision criteria discussed to deter- 
mine which among a set of alternative procedures is best. 
Matrix equations for the expected value and variance of 
the total loss were derived which depend upon the a priori 
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distribution on the starting level, the stopping rule, 
the estimator used to determine the mean, and the loss 
structure . 

In the special case, procedures of the form 
W(6^, k, 0, 1) were examined in some detail for k = 1,...,6 
and a particular estimator. It was found that choosing a 
number k* of observations per trial which minimizes the 
expected total loss is equivalent to choosing a Bayes 
procedure. It was also found that whether or not k* > 1 
depends upon the magnitude of the loss which is associated 
with the decision that the estimated mean has some value 
other than the true mean. In the special case, it was 
seen that the choice of a stopping rule is critical when 
defining a set of alternative procedures. A rule that 
stops the experiment too quickly may result in comparing 
experiments which have different sample sizes. 

Three alternative elevation procedures for the field 
artillery precision registration technique, used by the 
U.S. Army and Marine Corps were discussed and compared. 

It was seen that the current procedure may be considered 
optimal when there is no loss associated with the decision 
that the adjusted elevation has some value other than the 
true adjusted elevation. When there is a loss associated 
v/ith this decision which can be represented by one of the 
loss functions considered, it was seen that Dixon's 
modified up-and-down method strictly dominates the current 
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procedure. The author believes that this result Is signi- 
ficant and that the up-and-down method should be further 
evaluated as a candidate elevation procedure for the 
precision registration technique. 

It appears that further work in this general area of 
research would be justified. In particular, it would be 
interesting to study the various procedures under different 
stopping rules and to investigate the effect of the use of 
various estimators and loss structures. It would also be 
of interest to investigate multivariate analogs of some of 
the procedures. Indeed, it may be possible to model the 
flre-for-ef feet phase of a precision registration with a 
two or three dimensional version of the up-and-down method. 
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PROCrOURE TRANSITION MATRIX 
I-TH ROW IS PROBABILITY OF ENDING AT LEVEL J GIVEN 

the experiment starts at level I 
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CHNniTinNAL EXPECTED LOSS VECTOPS 

I-TH COMPONENT IS ‘EXPECTED TOTAL LOSS FOR 
ABOVE TYPE L'^SS F'JNCTI'^N WHEN LHSS PAPAMETER HAS 
VALUE J GIVEN EXPERIMENT STAPTS AT LEVEL I 
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CHNniTIONAL EXPECTED LnSS VECTORS 

[-TH Cn^iPONENT IS EXPECTED TOTAL LOSS FOR 
ABOVf^ TYPE LOSS FUNCTION WHEN LOSS PARAMETER HAS 
VALUE J GIVEN EXPERIMENT STARTS AT LEVEL I 
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CONDITIONAL VARIANCE VECTORS 

1-TH COMPONENT IS VARIANCE OF TOTAL LOSS FQR 
ABOV'^ TYPE LOSS FUNCTION WHEN LOSS PARAMETER HAS 
VALU'' J GIVEN experiment STARTS AT LEVEL I 
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CONOITinN^L EXDECTFD LOSS VECTORS 
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PROCEDURE TRANSITION MATRIX 
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0. 956S9 


0.04311 


0,00000 


C 

0 


o 


0 .^ 99099 


00001 


0,C 


0 , 0 


+ 1 


0^ 956B9 


0,04311 


0,00000 


0,0 


+ 2 


Oa ^1020 


0, 64669 


0,04311 


0, oooco 
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CHNniTIONAL EXPECTED LOSS VECTORS 

I-TH CQi^PONENT IS EXPECTED TOTAL LOSS FOR 
above: type loss FUNCTION WHEN LOSS PARAMETER HAS 
VALUE J GIVEN EXPERIMENT STARTS AT LEVEL I 





0 


10 


20 


30 


-2 


10, P3164 


14, 89656 


1 8, 86147 


22,82639 


-1 


R. 17245 


10, 285B3 


1 2.39R22 


14.51261 


0 


R, 00003 


11. 28135 


14 . 56258 


17,84399 


♦ 1 


B. 17245 


10, 2R584 


12.3R922 


14,51261 


♦ 2 


10.03164 


14, 89656 


18, R6147 


22, 82639 



CONDITIONAL VARIANCE VECTORS 

l-TH COMpomenT is VARIANCE OF TOTAL LOSS FOR 
ABOVE TYPE LOSS FUNCTION WHEN LOSS PARAMETER HAS 
VALUE J GIVEN EXPERIMENT STARTS AT LEVEL I 





0 


10 


20 


30 


-2 


4, 51190 


15, 55380 


74.47876 


181.28613 


-! 


0. 66029 


20,06314 


72.83037 


1 58.96165 


n 


9,00017 


22, 04895 


88. 19308 


198.43286 


+ 1 


0, 66029 


20, 06316 


72. 83032 


1 58,96159 


♦ 2 


4.51190 


15, 55379 


74.47876 


181. 2861 3 
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i:tE£_Laii_£iiN£IiQI^I__DUAQaAIi£. 



ClNDITinNAL EXPFCTED LOSS VECTORS 

I-TH COMPONEMT IS EXPECTED TOTAL LOSS FOP 
ABOVE TYPE LOSS RtlNCTION WHEM LOSS PARAMETER HAS 
VALUE J GIVEN EXPERIMENT STARTS AT LEVEL I 





0 


10 


?n 


30 


- *:> 


10. OTISA 


1 4, 3R7R5 


1?^, 8640^ 


2 ? , 83025 


-1 


R. 17?45 


10. 28730 


1 2o4^^?16 


14.5170P 




8, 0000 P 


11.28151 


14^ 


1 7„ 84447 




8. 17745 


10. 23701 


12<» 40216 


1 4. 51 ir.7 


^2 


n, ^31^4 


14, 80785 


le^ 86404 





CONDITIONAL VARIANCE VECTORS 



I-TH 


COMPONENT 


IS VARIANCE OF 


TOTAL LOSS 


for 


ABOVE 


TYPE LOSS 


function WHPN 


LOSS parameter has 


VALUE 


J GIVEN EXPERIMENT STARTS AT LEVEL 


I 




0 


10 


p/', 


30 


-2 


4. 51 100 


15.61 464 


74 , 73462 


1 81, 87158 


-I 


0, 56020 


20. 14548 


73,15894 


1 59.700'^ 8 


C 


0,0001 7 


27.05843 


88, 27852 


198, 51 050 


*-\ 


0, 66020 


20, 14548 


73. 15889 


1 59 , 70052 


42 


4, 51190 


15,61462 


74,73462 


181,87158 
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PRGCFDURE TR<\NSITinN MATRIX 



I-TH 


ROW IS PRORABILITY 


OF ENDING 


AT LEVEL J 


GIVEN 


THE 


EXPERIMENT 


STARTS AT 


LEVEL I 








-2 


-1 


0 


+ 1 


+ 2 


-2 


0,00001 


C. 30100 


0.58935 


0.01964 


0.00000 


-1 


0,00001 


0,067B6 


0, 91249 


0. C1064 


0. oocoo 


0 


0 . oocoo 


0.07031 


0. 85=>3« 


0.C7C31 


0,00000 


<-1 


OcOOOOO 


0,01964 


0,91 240 


0. 06786 


0. OOOOl 


+ 2 


0. 00000 


0, 01964 


0. 58935 


0. 39100 


0.00001 



PROCEOURE ITERATION MATRIX 



I-TH 


ROW IS PROBABILITY 


OF J TRIALS 


GIVEN 


the 


EXPERIMENT 


STARTS AT 


LEVEL I 






2 


3 


4 


5 


-2 


0, 37136 


0,60900 


0, 01 Q64 


0,00000 


-1 


0,93035 


0.01R64 


0,00000 


0,0 


0 


1,00000 


C. OOOCO 


O 

c 


0. 0 


* 1 


0,98035 


0. 01 964 


0, 00000 


0.0 


+ 2 


0,37136 


0.60900 


0,01964 


0.00000 
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CHNniTIOMAL EXPECTFO LOSS VECTORS 

T-TH C'^'^.PONENT IS EXPECTED TOTAL LOSS FOR 
ABOVE TYPE LOSS FUNCTION WHEN LOSS PARAYETEP HAS 
VALUE J GIVEN EXPERIMENT STARTS AT LEVEL I 





0 


10 


*> 


20 


_ 7 


1 3. ?41A2 


17. 347Q6 


? 1, 45451 


?5, 56107 


-1 


10, 09R21 


K, «7338 


ll,H485R 


12,7227? 


n 


10,00000 


11.40625 


12,81R51 


14, 21 876 


+ 1 


10. 0°B?1 


1 0, 


11, 84B55 


1 2, 7207? 


+ 2 


I 3o 24142 


1 7. 24796 


21,454^1 


25.56107 



CONDITIONAL VARIANCE VECTORS 



I-TH COMPONENT 


IS VARIANCE OF 


TOTAL LOSS 


FOR 


ABOVE TYPE LOSS 


FUNCTION WHEN 


LOSS PARAMETER HAS 


VALUE J GIVEN EXPERIMENT STARTS AT LEVEL 


T 


0 


10 


20 


20 


-2 6,68277 


10, 1572"' 


62, 02687 


1 62, 22251 


-1 0,48161 


10, 261 1 2 


36, 01448 


77,74162 


0 0,00002 


1 2.08514 


48, 34033 


108. 76566 


+1 0,48161 


10. 26112 


36,01450 


77. 741 67 


+ 2 6, 68277 


10. 15723 


62,03687 


162,32275 
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CONDITIONAL EXPECTFO LOSS VECTORS 

i-th component is expected total loss for 



ABOVF 


TYPE LOSS 


FUNCTION WHEN 


LOSS PAPAMETFR HAS 


VALUE 


J GIVPN EXPERIMENT STARTS AT LEVEL 


I 




0 


10 


20 


30 


-2 


13.24142 


17. 34R07 


21,45474 


25.56140 


-1 


1C.OP821 


10. 97350 


1 1. 84878 


12.72406 


C 


10.00000 


11.40625 


12.81252 


14. 21878 


+ 1 


10.00R21 


10. R7350 


11.84878 


12. 72406 


+ 2 


13, 24142 


17. 34B07 


21,45474 


25, 56140 





CONDI 


TI 


ONAL variance VECTORS 




I-TH 


COMPONENT I 


S 


VARIANCE OF TOTAL LOSS 


FOR 


ABOVF 


TYPE LOSS 


FUNCTION WHEN LOSS PARAMETER HAS 


VALUE 


J GIVEN EX 


PERIMENT STARTS AT LEVEL 


I 




0 




o 

o 


30 


-2 


6,68277 




10.16260 62.05859 


162. 37280 


-1 


0.48161 




10. 26778 36,04108 


77. 80141 


0 


0,00002 




12-03559 48.34204 


108.76921 


♦ 1 


0.48161 




10.26779 36.04108 


77, 80147 


+ 2 


6. 68277 




10.16260 62.05859 


162.37305 
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PROCFnUPE TRANSIT lOM MATRIX 

I-TH »nw IS RR 08 ABILITY OF EMHIMG AT LFVr.L J GIV^N 
THF FYPFRIMFNT starts AT L^V^L I 





-2 


-1 


0 








-? 


00000 


R-, 4 3 6C5 


0. 55S'^C 


0^009^5 


0, 


oocco 


-1 


0 >000'^0 


0 o 0 s 60 3 






r. 


Onroo 


0 


0, '^0<'00 


i 07P37 


Q> 


Oo 079^7 


r 

a 


OOCOO 


+ l 


c, coooo 


G-> 00 ^ 95 


0^<^r^r)i 




' ^ y 


00 COG 


+ 2 


0, 00000 


OoOi'aos 


55^00 


0,^3605 


c. 


00000 






procfoupf 


AT ihN 


MATR ! X 







I-TH 


ROW IS PS^BARILITY 


OF J TRIALS 


GIVEN 


the 


EXPPP I MEr)T 


starts at 


LBVFL I 










u 


5 


-2 


uzic^ 


0^ 560 9 5 


C., 00395 


ocooo 


-1 


0,9910^ 


0,09995 


0, 00000 


0,0 


r 


uooo^o 


0,00090 


0,0 


0 


+ 1 


QQIOE 


0, 00895 


Oo 00000 


C 

O 


+ y 


0 ., 42 7r 9 


0« 56395 


0,C0B<55 


0,00000 
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CnNOITIQNAL FXPECTED LOSS VECTORS 

I-TH COMPONPNT IS EXPECTED TOTAL LOSS FOR 
ABOVE TYPE LOSS FUNCTION WHFN LOSS PARAMETER HAS 
VAI.UE .1 GIVEN EXPERIMENT STARTS AT LEVEL I 





0 


10 


20 


30 


-2 


1 5 . A R 1 1 3 


19,94110 


24, 3R1 10 


23.84108 


-1 


12, 0B370 


1 3.00355 


13. 95340 


14. 90325 


/ 


11. 


13. 5673B 


15,13476 


16,70213 


+ 1 


12. 05370 


13.00355 


1 3, 95340 


14.R0325 


*■? 


1 5. 49113 


19. 94110 


24.39110 


28. 84103 



CONDITIONAL VARIANCE VECTORS 

I-TH COMPONENT IS VARIANCE OF TOTAL LOSS EQR 
ABOVE TYPE LOSS FUNCTION WHEN LOSS PARAMETER HAS 
VALUE J given experiment STARTS AT LEVEL I 





0 


10 


•90 


30 


-2 


9, 4035R 


6, 25317 


52.49707 


148.13672 


-1 


0. 31961 


9. 88820 


^6. 64963 


69, 60382 


0 


0.00009 


13. 21725 


52. 86861 


116.95435 


+ 1 


0.31Q61 


9. 88820 


36. 64967 


60. 60376 


+ 2 


9. 40359 


6. 25317 


52. 49707 


148. 13672 



116 



IYPF_L25S_fUiiJCIID!^l flyfiQSAliC 



CnMOlTIOM^L FXPFCTPn LO'^S VFCTOPS 

I-TH -vlT IS FXDECTFT ^niAL l.^SS FPR 

AROVF type LHSS FUNCTIOM WHEN LOSS OAOANFTER HAS 
VALUE J GIVPNl FXPRPIMFNT STARTS AT l.fVFL I 





o 


10 


7 [7 


7 




1 5 , 4 S ] 1 3 


1 Q , q 4 1 12 


?4, 3P1 11 


7 34111 


- 1 


] P , ") 5 ^ 7 0 


1 3, ''0^36 


1^,0^342 


14, 9'^77p 


r 


1 ’ ogqqq 


13, 567^4 


1 1 34 7^ 


16,70213 




1?-. OS 370 


13,00356 


1 ^ ,95742 


1 4„qn 7 79 




] 5,A'311 3 


IP. P4U? 


? 4, 391 1 1 


2 a, 84 1 1 1 



rOMniTIONiAL VAPIANEF VECTORS 



I-TH 


component 


IS VA9TANCP OF 


T<7TAL LOSS 


POP 


APOV^ 


TY09 L^SS 


FUNCTIOM WHEN 


LOSS n^RA^ETf^R HAS 


VALUE 


J GIVEN EXPERI'^ENT STARTS AT LEVEL 


I 




0 


10 


7 


30 


-7 


9. 4035 9 


6. 25766 


^ 2 , 40902 


148,14087 


-1 


0.31961 


9, 88B82 


36.65215 


80, 60045 


0 


0, ^oono 


1 ?, 21724 


‘=^2, 86 861 


1 1 8a 064 5 9 


+ 1 


0. 31 961 


9,88882 


36,65218 


80, ftOOOQ 


+ 2 


9,40359 


6, 25766 


5 2, 40 90.2 


148, 14087 
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THIS PROGRA^' COMPUTFS THE CONDITIONAL EXPECTED LOSS 
AND VARIANCE OF THE LOSS FOR PROCEDURES W(5ltK,0,l) 

K = l,,..,6 FOR A J INEAR OR QUADRATIC LOSS FUfTCTION 
WHERF the rule Si IS TO STOP WHEN ROTH RESPONSES AND 
NINRESPGNSES HAVF BEFN OBTAINED AT TWO SUCCESSIVE 
LEVELS. 



INTEGER HI 5) ,HSQ(5) 

DIME NS ION N( A) ,NSQ ( A) , A( 5, 5 ) ,B ( 5,4 I ,C ( 5,5 ) tWl ( 51 , W2( 51 
1,W3(5),WA(5I,R(5),RP(5,A>,E(5),D(5),V(5I,VP(5,A) 

F5 EORMAT(hI5) 



190 E JRMAT (• 1 •, ////T56, 'RESULTS FOR K = ',I2/' + ', 

1T55,'_ _ _ _ *) 

2CO FORM ATl//7777,T5l,'’'t>RDrEOURE TRANSITION MATRIX'/// 
1TR8,'I-TH ROW IS PROBABILITY OF ENDING AT LEVEL J' 
2T30, 'GI VEN' //TBB, ' THE EXPERIMENT STARTS AT LEVEL I'/// 
3TA7,'-2',8X,'-l',9X,'0',eX,'+l',8X,'+2'/// 

^T39, '-2' ,5F10.5//T?9, '-1 ' , 5 F 1 0 . 5/ / TAG , ' 0 • , 5E 1 0. 5/ /T 39 , 
5' +1 ' , 5f^ 10. 5//T39, ' <■ 2' ,5F10. 5 ) 

’05 FORMAT I////// ,T52, 'PROCEDURE ITERATION MATRIX'/// 
1TA3,'I-TH ROW IS PROBABILITY OF J TRIALS GIVEN'// 
2TA3,'THE EXPERIMENT STARTS AT LEVEL I'/// 

3T5 2,'2',9X,’3',9X,'‘»',9X,'5'/// 

ATAA, '-2 ' ,AF m. 5//TA4, • -1 • , 4F 1 0. 5/ / TA 5 , ' C ' , AF 10 , 5/ /T AA , 
5' +1 ' ,AP ID, 5//TAA, ' + 2' , AFIO. 5) 

220 FORMAT (' 1 ', ////T50, 'TYPE LOSS FUNCTION: '1 

222 F OR MAT! '+',T71, 'LINEAR '/•♦', 






1 T 20 , ' 

FORM ATT ' 4- ' 



+ • » 



. . 7T7T“ouAwrrTrr7 

1T50, ' ' ) 

3C FORM ATT7777777TA^7'»’^nN DTTTDKiSL "TxPFC T E 0 LOSS 

1//T39,'I-TH COMPONENT IS EXPECTED TOTAL LOSS . wr , / 
2T39, 'ABOVE TYPE LOSS FUNCTION WHEN LOSS PARAMETER HAS' 



VECTORS' / 
FOP ' // 



LOSS 

?»ri_ L UJ J J UL-iJJ PARAr*uij_r\ 

3//T39 ,' VALUE J GIVEN EXPERIMENT STARTS AT LEVEL I'/// 
AT50,'C',10X,'10',10X,'20',10X,'30'/// 

ETAO, '-2' , AF 12. 5//TA0, '-1 ' , AF12. 5//TA1 , 'O' , AF12, 5//TA0, 
6'+l',AF12.5//TA0,'+2',AF12.5» 

FORMAT! ////// ,T50, 'CONDITIONAL VARIANCE VECTORS'// 
rrMPciMPMT 1C v/AiiiAwrp np TnTAi I ncc pno* 



0 .£, ,-ri 

?A0 FORMAT! ////// ,T50, 'CONDITIONAL 

iT^c.,i_Tu COMPONENT IS VARIANCE OF 
TYPE LOSS FUNCTION WHEN 



- /// 

TOTAL LOSS FOR'// 

9, 'ABOVE TYPE LOSS FUNCTION WHEN LOSS PARAMETER HAS' 
T39, 'VALUE J GIVEN EXPERIMENT STARTS AT LEVEL I'/// 

. ...0,'P' ,10X,'10' ,10X,'2C',10X, '30'/// 

5TAO,'-2' ,AF12. 5//TA0, ' -1 ' ,AF12.5//T4l,'G',AF12.5//T40, 
6' +1 ' , AF 12. 5//TA0, ' +2' , AF12. 5) 



1T39, ' I-TH 
2T39, ' ABOVE 

3//T39 

A T 5 0 



INPUT THE VECTORS N AND NSQ. 



READ!5,95) !N! I) , 1 = 1 ,4) 

RFADI5, 951 INSQ! I ) , 1=1 ,A) 

K IS THE NUMBER OF OBSERVATIONS PER TRIAL. 



DO 50 K=l, 6 

CCMPUTB A, B, AND C MATRICES. 

CALL PRn!K,A,B,C) 

WRITE! A,19G)K 

WRITE!B,2CO)!!A!I,J),J=l,5),I=l,5» 

WRITE!6,20 5)!!8!I,JI,J = 1,AI,I=1,5) 

PERFORM COMPUTATIONS FOR TWO LOSS FUNCTIONS USING 
FOUR VALUES OF THE LOSS PARAMETER. 



DO 5C 1 = 1,2 
00 25 J=1,A 

THE FOLLOWING SUBROUTINES COMPUTE THE VALUES OF THE 
CCMPGNENTS OF R=AH4-KBN, THE CONDITIONAL LOSS VECTOR, 
AND STORE IN A MATRIX FOR OUTPUT LATER. i 
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CiLL L ■'■SS ( I , J , H, MS J ) 

CALL ( -,A,H,W1 ) 

CALL, P'^'i'sOl (4, H,N,W? ) 

C Al I. PPrn^i ( K , W2 , W’ ) 

CALL SM^M W1 , W3 ,P ) 

C ALL TAPLE! ( J ,P.,SP I 

Tu: c'HLAwICG SU'-P HJT 1 S C’^^piJT^ THt VALtltS HC THC 

C '••1P'"'rNTS 'f V = C-niAGONAL OF G, Tit-" COOniTlONAL 
VA’vIA'-JP' V-fy^Pf ANO .SFGRF in a PA'!''-IX FPP output 

LATFF, 

fall PKOJl ( , A ,HSO, ,^1 ) 

CALL P" ■’01 ( A, G,USFj, w2 ) 

K 1 = K K 

CALL P' 003 ( k 1 , ir 2 , w3 ) 

FALL SOM(Wl ,'a3,w'-) 

C ALL PPOOl ( , C,H ,v-.’ ) 

K 1 = / • X 

CALL PP0‘)3 (K 1 , W1 P I 
C ALL S I'-' ( n'A , F ) 
r ALL no? ( r. , 0 , wl ) 

K ' = - ■> 

CALI ‘ pH ( K 1 , , (J ) 

call SUM(F,r,v) 

C Al L TA-.l F 1 ( J , V, VP » 

I F ( J yo. 1 ) W« ITF ( ^ , ? PA ) 

I F ( I ,F0, 1 . AMO. J. Fo, I ) WRI TF (^ , P? p ) 

IF( I .‘-0,2,A^i0..|, 1 IWRI TF(c,22 3) 

cr vT luu'- 

jurpin TIIF r 'NOTIONAL FXPrCTF!) I TSS ANU VAPIANCF 

rr THF LOSSo 

W H l T F ( ^ , P A - I ( ( ;^ P ( L , *>') , 'A = 1 , ^ I , L = 1 , 5 ) 

K • ITF (• , '4C ) ( ( VP ( L , ’'^O , M=1 , A ) ,L = 1 , F ) 

STOP 

LUO 



SLOr.rjTloF fma(k,A,P,CI 

This S LOGOUT IMF OOM^UTtS flcMF-n,tS ’F THF A, 6, AND L 
MUPICFS* F(I,N,J) IS JOINT CCMPI T U.’NAL P'^P-iAn I L I TY 
that thC F.XPFrimkJT FNOS AT LEVFl I ArTFP N TRIALS 

givfm IT starts at level j. 

L 1 MS I ON H ( , A , S ) f A I S , A ) , 4 ( F , ^ , C ( E f S ) , G < ? ) 

Act Al =P . "If h 
bF T A ' = S 

ALPHA! A. 

PI = ( pry ai ) K 
CJi = ( ALPHAl ) K 
R 1=1 -PI -01 
pO=(PFTAP)- K 
P ~ = 1 - A PI 

OF I = l,s 
on ^ N = i ,4 
O O =. J = 1,S 
F ( I ,A , J )=0 
F ( 1 , ! , 1 ) =Pl 
F ( 2, 1 , 1 )=R I 
F ( 2 , ?, ] ) =P0 - Q1 

F ( 3 , F , 1 ) =p r. (ji 

F ( 4 , i , I ) = P j • Q 1 '• ( 1 - P 1 ) 

r (3,4 , 1 )=pp-. PI v.Qi 

CALL GAYMA (K,-l ,PFTA1 ,G) 

F( 1 , 1,2 )=P1+G( 1 I 
F(2,i ,2)=F(2,2,1 )+G(2) 

F ( 3, : , F ) =F ( 2, ?, 1 ) + (',( A ) 

F ( 4 , 2 , 2 ) = F ( 4 , T , ! ) 
b ( F , 2, P ) =F ( F, A , 1 I 
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C ALL 


1 *. 




v.A ( K , 0 


f 


ti P T A H , G » 


"(it 








=P0 ‘PI 






P ( % 


i f 






= PC'-'( 1 


- 


P! ) +G( 1 ) 


F ( -, 


1, 


- 




= G( 7 ) 






f ( V , 




1 




= P ( 1 


- 


P I I 4 G ( ? ) 


M 5 , 


"5 






= F ( , 2 




•1 ) 


FALL 








"A ( X , 1 


» 


ALPhAI , G) 


F ( 1 , 


} f 


/t 




= F ( A , .-5 


f 


2 I 


F ( ^ 


/ y 






=F ( A , 2 


f 


2 ) 


F( 


1 f 






= F ( 2 


f 


1)40(1) 


F ( •- , 


1 t 


/. 




= F ( ' 


f 


: ) 4,i( 2 ) 


F ( > t 


1 y 






=P 1+G( 




) 


P ( I t 








=F n , ’ 


T 


) 


r ( ?. , 


J 


c; 




■=F ( 3 ,2 


f 


A ) 


F ( • , 




i. 




= F ( :, 2 


f 


1 ) 


r ( A, 


] 1 






=r ! 


f 


1 ) 


F ( A, 


r y 






= F ( , 7 


f 


1 ) 


F ( - , 


1 f 






= F ( 1 , 1 


f 


1 ) 


nr 1 


n 


i 


- 


’ , p 






■> ■' 1 




J 




1 f 






A ( I , 


J ) 


= 


n 








f; ( F , 


J) 












no 

.i i 


r 




=r 


1, - 







■ <'. ( I , J I = r ( 1 , j ) 4 ( N 1 1 ( I- ( j , , I) 
O' ] 1 1=1,*- 
r 1 :> \' = 1 , 

' ( r , I - . 

0 .! 1 “ J = i , - 

1 •- ■> ( 1 , " ) ='•, ( I , \ » + F ( J, 0, 1 I 

TU'-^N 

•:-Mo 



bLt-K'OT 1 NiF (' A'^'-'A (K , •), ALPHA, P I 

T'-^IS SU'l-UOT I N. i' CLl'-iPtJTFS A FP A f. T I 0 'J AL Pf'PTinK- IF 
PUV = I|:J = I), p u M= I -1 1 -; = 1 ) A\MJ pp ( N'= I +1 1 Q= I) ; l = 

r I p*- A'F I D,''' i> I " ) 

1 =( K , -0. 1 ) or T';' 15 0 
'-,^TA = 1 ..O- ALPHA 
J VAX =K -1 
CALL FaCT(K,KF) 

KO=K /? 

K 1 = K ■ ■■ 

F < = K/’„ ■'-K- 
I F( FKovOToP )K] =KP+I 
K ?=2 -'‘K 
M - L 

- StiViJH=-,0 

PC KO J = 1,J'1AX 
K J = K- J 

call F.ACT(J,JF) 
call FACT(KJ,KJF) 

KC = Kr/ ( JF^^K jri 
X 1 =ALPHA ->• J 
X2 = FFT.i* = K J 
pji = Kc xi^xr 
I F ( Q ) 1 L C 

0 = -l , V, OP 4-1 IS THt- STARTING LirV'L-. 

I ' r; 1 T ( 1 i , 1 2 , 1 

^' = 1, 2, HR ■! NFANS: IF 1, GU OHi\'N A LFVFL; 

IF ?, STAY AT THt SAMF L F VE L ; 
IF 3, GO UP A LTV FI, 

II N,v iN = k' 2 -XO- J 
(\NAX=F ^'-1 - j 
GO T': AC 
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12 NMIN=K1-J 

NNAX=K2-Kn-1-J 
G 3 TO AO 
n NWIN=1-J 

nwax=ki-i- J 

GO TP- c^O 

’0 GQ TO (21,2?,?^), M 

21 NVIN=K2-K0-J 
NMAX = K2-1- J 
GQ TO AO 

22 NVIN=K0>1-J 
NJMAX=K2-K0-1-J 
GC TO -0 

2^ NMINi = l-J 
N^'AX=K0-J 
GC TO AO 

’C GO TO ( 31,32,33) , M 
M KyiN=K2-Kl+l-J 
NVAX=K2-1-J 
GT TO AO 
3? \min=K 0+1-J 
NN'AX^KO-Kl - J 
GO TO AO 
33 N'3IN = 1-J 
NVAX=KO- J 

a: lF(NMlO.LT.C,A\'n.NMAX,LT.O)Gn TO ai 
IF(N^^IN,GT,K. A'ND.NMAX.GT.K )GC) TO Al 
IF(NVIN,GT.NMAX)GO TO Al 
1 F(NM IN.LT, C, ANO,NMAX,Gr,0 )NMIiM = G 
IF(NMlfj,LE.K, AND,NMAX,GT.K )NMAX = K 
IF(NMIM,CQ,C, AMDoNMAX.EQ.OIGO TO A?. 
I F(NMIN. EQ.K, ANO,NMAX. EO.K )GG TO A3 
I F( NMIN. CQ, 0, ANjn,NMAX. GT.O )G0 TO AA 
GO TO A3 
Al pj'’=0.r 
GC TC inn 
i-7 P J2=3ETA’-'+K 
GO TO 100 
h3 P J2=ALPHA* - K 
GO TCI 100 

AA PJ2=otTA^*K 
\MI N = 1 

GO TO A 9 
A3 PJ2=0.0 

A9 DO 50 N=NMIN,NMAX 
KN=K-N 

CALL FACT(N,NF) 

CALL FACT(KN,KNF) 

NC=KF/( NF*KNF ) 

Y1 = ALPHA’-*N 
Y2 = PFTA< *KN 
50 PJ2=DJ?+NC-’Ylr«Y2 
ICC SUVJr = SONJN + PJl *'PJ2 
P( M) =SUMJN 
IF(m.EO,^)FlTIJPN 

V = M+1 

GO TO t 

150 DO 155 1=1,^ 

15 5 P ( I ) =0 . 0 
RFTUPN 
FNO 



SLBPOUTINE FACT(N,NF) 

THIS SUBROUTINE COMPUTES N FACTORIAL FOR INTEGER 

N=0,1,«»« ,1G« 

I=N 
NF = 1 

IFIN.LF.OIGO to 15 
10 IFIN.GT.OGP TO 20 
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L^SS( N, J ,M,HSQ) 



K = I 

\i r = |\! i: r.. 

N = N-1 
G"' T" 1 
\'i; 



Ml' G'tlT I Cijy'-’UTf'S L.iSS V'CT :■ S H AMR HS'J F l'< 
Ty!>, , iF L'. Ss FUNCn O'MS : 
i - I 

■’ - U ^ 0 ^ A T I C 

^ MSS P AF A -1 ■■■ T: f> -TA HAS VALIM^S i , 1S, 20t AHH 

1 V I --T A ,H( S » ,HS :J( I 
F T A= ( J- 1 ) 1 S 

I " ( J, 1 I G' T I ' 

- I Tf! ( I ,? ) , 'J 

n- I = 

( I + ‘ I = I eta 

H'-' 3 2 1 = - , ? 

H( I M '-.-I I 

H CM = ' 
r,' TL' 

'*•- ’0 I =i,2 
y ( 1 + ? ) = I ' I •■ TA 
('. -> T ■ 1 1 

L'"' n 1=1,' 

H ( I I = ^- T A 

C • i ! = 1 , ' 

HS'.'I I ) = t(( I I H( 1 ) 

S '- T|)l/ \J 

Fr^n 



SL’^'-' 1 I"" I HF PP >1 ( M , X , A , K ) 

TF<IS SHIV'ODT f .\j; PnST-PlJLT I PL I FS A 'MTS IX PY A VCCTOP» 
A(^-» 

TIyFKSICA; X(S,S),!UF) 

'T ! '• I -- 1 , r 

y ( I I =0 

OP I-' J^1,S 

f< ( I ) = i ( 1) + X ( I , J ) ( J » 

pc7D,..-| 

-XT 



S'jP^ SHT IMF PPPiJ'? ( A , A, X ) 

TrMF SMMOlITJMr C'TMPHTFS THE OIAGHM-AL OF TH- O MATRIX, 
. I 'M-\S Ii;M A ( I , H ( 5 ) , X ( ) 

.) I 10 1=1,^ 

X ( 1 ) = A ( n “ ( I I 



SL'<'^ lot IMF PRO ’'’ ( K , A, P ) 

ThM SOpsOHT I !\'~ HULTIPt.SS A VECTOR rfV A C'^NSTAMT, 

•■'! -^FNST! N A (b) ,RC^ ) 

O’ M I = 1 , E 
" ( I ) =K A ( I ) 

R-'TORM 

CMD 
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SLBKOlJTfNE SUV(A,R,C) 

THIS SUBkOUTIMF SUM$ TWU VECTORS. 

0 T'^ENS I PM A ( E ) ,B ( 5 ) ,C( 5 ) 
nr 10 1=1,5 

10 c ( I) =A( n + Rm 

RETURN 

END 



SUBPPUTINE TABL‘^l(N,A,X) 

THIS SUHROLTINE STORES A VECTOR IN THP N-TH CUIJJNM 
CF A 'MATRIX, 

D r^E NS I CN A (<=;) ,X(5,A> 
m ir, 1 = 1,5 
n X ( I ,NI =A( T I 

RETURN 

FNO 

OATA CAR ns 

7 5 4 5 

4 o 15 25 
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